-- Logs begin at Fri 2021-07-30 15:28:29 UTC, end at Fri 2021-07-30 16:26:30 UTC. -- Jul 30 15:58:43.461619 dv-cinder-803046-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 30 15:58:43.470994 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 30 15:58:43.472771 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 30 15:58:43 2021] *** Jul 30 15:58:43.472771 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 30 15:58:43.472771 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 30 15:58:43.472771 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: nodename: dv-cinder-803046-3-iscsi Jul 30 15:58:43.472771 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: machine: x86_64 Jul 30 15:58:43.472771 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: clock source: unix Jul 30 15:58:43.472771 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: pcre jit disabled Jul 30 15:58:43.472771 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: detected number of CPU cores: 4 Jul 30 15:58:43.472771 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: current working directory: / Jul 30 15:58:43.472771 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: detected binary path: /usr/bin/uwsgi-core Jul 30 15:58:43.473568 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: your processes number limit is 47680 Jul 30 15:58:43.473568 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: your memory page size is 4096 bytes Jul 30 15:58:43.473568 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: detected max file descriptor number: 2048 Jul 30 15:58:43.473568 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: lock engine: pthread robust mutexes Jul 30 15:58:43.473568 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: thunder lock: enabled Jul 30 15:58:43.473568 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 30 15:58:43.473568 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Jul 30 15:58:43.517113 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: Python main interpreter initialized at 0x55dcda64f9c0 Jul 30 15:58:43.517113 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: python threads support enabled Jul 30 15:58:43.517113 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: your server socket listen backlog is limited to 100 connections Jul 30 15:58:43.517113 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: your mercy for graceful operations on workers is 90 seconds Jul 30 15:58:43.517438 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: mapped 403077 bytes (393 KB) for 2 cores Jul 30 15:58:43.517514 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: *** Operational MODE: preforking *** Jul 30 15:58:43.517773 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: *** uWSGI is running in multiple interpreter mode *** Jul 30 15:58:43.517773 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: spawned uWSGI master process (pid: 92477) Jul 30 15:58:43.520962 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: spawned uWSGI worker 1 (pid: 92478, cores: 1) Jul 30 15:58:43.520962 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: spawned uWSGI worker 2 (pid: 92479, cores: 1) Jul 30 15:58:43.520962 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 30 15:58:43.517954 dv-cinder-803046-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 30 15:58:45.169973 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 15:58:45.169973 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: from cryptography.utils import int_from_bytes Jul 30 15:58:45.170709 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 15:58:45.170709 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: from cryptography.utils import int_from_bytes Jul 30 15:58:45.170862 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 15:58:45.170862 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: from cryptography.utils import int_from_bytes Jul 30 15:58:45.170862 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 15:58:45.170862 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: from cryptography.utils import int_from_bytes Jul 30 15:58:47.851270 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 30 15:58:47.851926 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 30 15:58:47.852039 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 30 15:58:47.853787 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 30 15:58:47.853787 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 30 15:58:47.853787 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.854068 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.854326 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.854646 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.854978 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.855319 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.855642 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.855959 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.856288 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.856554 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.856871 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.857200 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803046-3-iscsi {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.857522 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.857927 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.858143 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.859309 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.859477 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 30 15:58:47.859477 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 30 15:58:47.861098 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.861098 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.861359 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 30 15:58:47.861480 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.861480 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.861480 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.861855 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 30 15:58:47.861990 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.862118 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 30 15:58:47.862252 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.862252 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.862495 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.862625 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.862747 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.862873 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.863001 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.863147 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.863284 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.863424 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.863552 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.863685 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.863814 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.863942 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.864079 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.864211 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803046-3-iscsi {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.864332 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.864454 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.864587 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.864715 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.864835 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.864963 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.865090 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.865090 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803046-3-iscsi {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.865339 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.865459 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.865586 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.865708 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.865834 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.865961 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.866095 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.866223 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.866352 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.866480 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.866602 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.866734 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.866866 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.866994 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.867121 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.867121 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.867381 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.867515 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.867646 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.868355 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.868493 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.868718 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.868844 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.869059 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.869196 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.869377 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.869517 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.869688 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.869821 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.870008 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.870140 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.870262 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.870398 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.870557 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.870691 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.870879 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.871011 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.871225 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.871549 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.871801 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.871933 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803046-3-iscsi {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.872058 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.872250 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.872381 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.872548 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.872683 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.872870 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.873010 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.873247 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.873378 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.873556 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.873693 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.873862 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.874004 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.874167 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.874300 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.874474 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.874601 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.874780 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.874992 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.875118 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.875291 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.875422 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.875551 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.875722 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.875855 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.876041 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.876173 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.876344 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.876475 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.876657 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.876791 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.876965 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.877101 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.877283 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.877416 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.877590 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.877717 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.877898 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.878025 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.878147 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.878276 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.878443 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.878577 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.879012 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.879183 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.879354 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.879482 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.879674 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.879806 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.879935 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.880060 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.880191 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.880327 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.880456 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.880580 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.880770 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.880897 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.881080 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.881224 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.881388 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.881522 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.881694 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.881821 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.881997 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.882122 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.882302 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.882428 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.882605 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.882736 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.882908 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.883033 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.883219 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.883395 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.883571 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.883705 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.883908 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.884038 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.884247 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.884374 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.884555 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.884688 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.884861 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.884995 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.885165 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.885294 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.885468 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.885594 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.885773 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.885908 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.886075 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.886209 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.886377 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.886513 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.886693 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.886826 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.887010 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.887179 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.887342 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.887483 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.887647 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.887778 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.887948 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.888079 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.888253 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.888415 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.888568 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.888709 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.888871 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.888998 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.889175 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.889311 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.889441 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.889565 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.889709 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.889846 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.890015 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.890150 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.890332 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.890459 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.890637 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.890764 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.890927 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.891062 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.891243 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.891366 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.891544 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.891682 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.891846 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.891971 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.892150 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.892282 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.892454 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.892579 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.892757 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.892883 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.893055 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.893180 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.893356 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.893481 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.893654 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.893782 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.893954 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.894085 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.894251 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.894382 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.894552 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.894682 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.894849 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.894984 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.895172 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.895301 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.895483 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.895611 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.895786 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.895918 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.896088 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.896221 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.896388 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.896519 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.896690 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.896825 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.896990 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.897115 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.897308 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.897435 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.897611 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.897737 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.897913 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.898052 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.898226 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.898353 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.898533 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.898659 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.898837 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.898986 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.899226 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.899458 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.899654 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.899820 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.899955 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.900127 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.900255 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.900429 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.900560 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.900732 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.900866 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.901034 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.901170 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.901333 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.901460 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.901634 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.901842 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.901974 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.902105 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.902228 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.902350 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.902507 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.902644 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.902804 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.902932 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.903117 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.903259 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.903458 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.903599 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.903764 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.903898 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.904069 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.904197 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.904371 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.904506 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.904686 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 15:58:47.904822 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.905018 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.905146 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.905356 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.905493 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.905680 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.905813 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.905992 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.906124 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.906311 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.906448 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.906625 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.906758 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.906936 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.907063 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.907273 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.907405 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.907585 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.907718 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.907896 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.908022 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.908207 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.908341 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.908521 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.908648 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.908832 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.908962 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.909146 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.909273 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.909453 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.909587 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.909762 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.909895 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.910068 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.910203 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.910377 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.910505 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.910681 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.910808 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.910987 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.911113 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.911307 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.911433 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.911637 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.911774 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.911957 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.912084 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.912262 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.912388 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.912575 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.912711 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.912888 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.913025 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.913197 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.913333 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.913513 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.913659 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.913820 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.913945 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.914125 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.914257 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.914436 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.915097 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.915342 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.915469 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.915655 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.915784 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.915978 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.916104 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.916282 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.916408 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.916591 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.916728 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.916908 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.917036 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.917222 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.917349 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.917538 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.917673 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.917847 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.917975 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.918154 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.918281 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.918461 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.918587 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.918768 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.918903 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.919070 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.919221 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.919422 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.919562 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.919737 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.919862 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.920048 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.920178 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.920373 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.920506 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.920679 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.920811 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.920983 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.921114 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.921290 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.921423 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.921593 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.921716 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.921899 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.922028 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.922203 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.922339 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.922507 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.922638 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.922808 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.922941 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.923113 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.923274 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.923440 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.923566 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.923744 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.923878 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.924049 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.924178 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.924349 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.924474 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.924665 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.924799 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.925002 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.925128 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.925251 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.925380 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.925545 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.925673 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.925878 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.926004 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.926180 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.926305 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.926496 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.926627 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.926812 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.926939 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.927161 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.927310 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.927471 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.927607 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.927792 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.927917 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.928079 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.928207 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.928385 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.928520 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.928698 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.928833 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.929022 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.929148 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.929328 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.929462 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.929637 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.929769 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.929941 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.930066 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.930304 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.930954 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.931124 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.931315 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.931466 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.931605 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.931775 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.931914 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.932082 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.932209 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.932389 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.932537 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.932712 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.932847 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.933024 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.933151 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.933329 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.933456 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.933634 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.933762 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.933939 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.934074 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.934262 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.934387 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.934574 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.934702 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.934881 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.935005 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.935215 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.935345 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.935543 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.935677 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.935834 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.935955 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.936143 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.936279 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.936452 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.936580 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.936757 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.936886 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.937068 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.937204 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.937389 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.937517 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.937693 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.937820 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.938005 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.938145 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.938310 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.938445 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.938612 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.938737 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.938916 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.939051 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.939250 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.939377 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.939558 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.939686 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.939862 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.939998 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.940167 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.940295 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.940471 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.940693 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.940823 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.940961 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.941086 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.941209 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.941360 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.941494 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.941668 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.941797 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.941979 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.942106 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.942293 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.942418 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.942599 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.942725 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.942906 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.943032 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.943229 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.943366 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.943545 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.943673 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.943855 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.943981 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.944156 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.944291 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.944456 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.944582 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.944761 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.944886 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.945072 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.945208 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.945379 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.945503 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.945695 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.945855 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.946044 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.946266 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.946400 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.946524 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.946646 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.946768 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.946937 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.947074 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.947270 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.947398 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.947574 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.947714 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.947881 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.948146 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.948276 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.948481 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.948608 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.948798 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.948925 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.949098 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.949224 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.949414 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.949540 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.949732 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.949871 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.950038 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.950196 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.950351 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.950478 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.950662 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.950799 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.950963 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.951089 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.951298 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.951426 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.951607 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.951743 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.951911 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.952043 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.952215 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.952340 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.952521 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.952656 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.952826 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.952958 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.953128 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.953252 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.953439 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.953574 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.953742 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.953874 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.954043 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.954168 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.954374 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.954508 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.954632 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.954761 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.954929 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.955054 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.955256 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.955384 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.955570 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.955819 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.955946 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.956159 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.956296 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.956477 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.956604 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.956776 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.956901 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.957082 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.957218 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.957391 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.957518 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.957722 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.957847 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.958028 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.958154 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.958348 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.958473 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.958654 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.958790 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.958963 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.959091 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.959294 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.959422 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.959600 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.959726 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.959909 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.960038 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.960213 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.960339 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.960515 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.960640 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.960816 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.960943 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.961120 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.961248 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.961452 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.961643 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.961773 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.961896 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.962055 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.962188 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.962360 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.962499 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.962668 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.962811 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.962968 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.963093 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.963297 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.963435 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.963602 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.963729 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.963905 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.964038 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.964220 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.964346 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.964523 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.964652 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.964821 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.964946 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.965121 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.965247 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.965426 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.965554 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.965734 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.965861 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.966036 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.966166 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.966345 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.966474 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.966646 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.966774 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.966963 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.967091 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.967280 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.967407 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.967592 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.967726 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.967897 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.968033 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.968199 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.968324 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.968501 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.968627 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.968801 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.968935 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.969105 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.969233 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.969406 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.969534 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.969710 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.969848 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.970020 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.970154 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.970321 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.970448 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.970624 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.970749 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.970927 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.971055 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.971258 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.971386 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.971561 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.971688 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.971873 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.972002 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.972181 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.972309 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.972476 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.972601 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.972778 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.972906 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.973077 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.973203 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.973380 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.973515 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.973679 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.973806 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.973980 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.974105 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.974277 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.974411 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.974578 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.974704 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.974878 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.975003 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.975209 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.975353 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.975512 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.975639 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.975811 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.975937 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.976116 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.976256 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.976415 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.976542 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.976736 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.976856 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.977563 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.977787 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.977951 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.978120 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.978260 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.978393 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.978594 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.978724 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.978855 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.978979 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.979109 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.979247 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.979384 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.979516 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.979668 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.979796 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.979974 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.980108 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.980284 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.980412 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.980589 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.980710 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.980894 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.981021 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.981199 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.981327 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.981500 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.981633 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.981801 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.981926 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.982106 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.982234 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.982411 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.982537 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.982714 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.982854 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.983017 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.983176 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.983366 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.983491 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.983672 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.983812 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.983974 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.984107 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.984281 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.984407 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.984582 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.984716 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.984889 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.985014 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.985199 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.985332 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.985510 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.985646 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.985822 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.985959 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.986133 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.986260 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.986443 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.986579 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.986753 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.986880 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.987061 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.987203 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.987403 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.987532 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.987709 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.987835 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.988021 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.988150 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.988329 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.988455 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.988638 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.988762 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.988939 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.989063 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.989244 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.989372 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.989545 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.989669 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.989854 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.989993 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.990159 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.990288 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.990477 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.990601 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.990796 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.990935 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.991119 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.991297 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.991444 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.991570 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.991754 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.991893 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.992065 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.992192 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.992374 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.992501 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.992725 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.992879 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.993066 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.993196 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.993438 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.993567 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.993754 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.993890 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.994067 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.994204 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.994379 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.994516 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.994685 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.994829 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.994990 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.995116 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.995322 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.995449 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.995628 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.995755 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.995933 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.996067 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.996233 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.996365 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.996524 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.996652 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.996844 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.996969 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.997146 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.997272 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.997449 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.997576 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.997761 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.997887 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.998066 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.998199 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.998475 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.998602 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.998790 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.998915 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.999101 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.999268 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.999435 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.999563 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.999748 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:47.999876 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.000059 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.000200 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.000376 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.000511 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.000693 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.000820 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.001000 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.001137 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.001336 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.001462 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.001661 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.001796 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.001984 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.002124 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.002298 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.002432 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.002599 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.002725 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.002903 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.003038 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.003237 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.003366 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.003560 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.003934 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.004116 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.004243 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.004422 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.004556 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.004727 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.004856 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.005048 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.005183 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.005352 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.005479 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.005674 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.005808 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.006057 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.006183 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.006361 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.006498 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.006666 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.006793 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.006976 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.007104 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.007306 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.007433 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.007614 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.007825 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.007952 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.008076 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.008229 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.008890 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.009081 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.009239 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.009394 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.009623 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.009749 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.009944 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.010080 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.010257 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.010386 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.010583 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.010710 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.010885 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.011009 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.011230 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.011369 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.011548 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.011674 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.011851 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.011990 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.012173 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.012302 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.012477 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.012594 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.012798 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.012936 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.013104 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.013231 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.013409 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.013537 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.013714 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.013850 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.014018 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.014145 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.014359 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.014487 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.014665 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.014801 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.014984 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.015118 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.015337 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.015466 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.015645 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.015788 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.015950 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.016078 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.016256 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.016384 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.016578 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.016708 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.016890 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.017018 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.017201 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.017320 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.017512 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.017641 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.017813 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.017963 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.018101 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.018231 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.018404 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.018544 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.018741 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.018866 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.018996 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.019120 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.019309 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.019449 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.019622 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.019751 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.019926 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.020053 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.020327 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.020451 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.020586 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.020711 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.020835 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.020959 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.021119 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.021256 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.021438 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.021564 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.021742 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.021868 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.022041 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.022176 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.022342 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.022468 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.022646 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.022781 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.022979 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.023114 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.023294 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.023416 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.023624 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.023753 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.023980 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.024127 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.024309 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.024438 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.024638 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.024768 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.024948 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.025085 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.025270 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.025398 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.025586 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.025714 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.025901 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.026036 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.026215 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.026342 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.026520 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.026646 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.026832 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.026962 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.027154 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.027284 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.027463 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.027592 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.027770 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.027898 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.028072 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.028198 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.028377 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.028504 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.028681 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.028816 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.029003 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.029198 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.029326 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.029529 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.029673 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.029846 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.029974 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.030160 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.030287 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.030471 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.030607 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.030771 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.030906 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.031092 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.031234 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.031426 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.031561 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.031733 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.031860 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.032045 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.032181 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.032355 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.032485 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.032681 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.032799 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.032991 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.033132 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.033313 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.033443 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.033630 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.033758 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.033943 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.034079 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.034257 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.034383 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.034568 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.034701 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.034883 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.035019 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.035221 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.035352 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.035542 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.035674 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.035838 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.035967 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.036151 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.036279 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.036466 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.036593 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.036788 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.036924 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.037103 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.037309 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.037437 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.037637 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.037775 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.037952 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.038086 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.038263 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.038399 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.038573 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.038713 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.038891 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.039018 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.039227 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.039357 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.040047 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.040197 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.040443 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.040625 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.040816 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.040944 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.041081 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.041216 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.041362 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.041488 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.041679 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.041807 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.042006 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.042201 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.042329 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.042523 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.042651 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.042862 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.042990 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.043215 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.043348 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.043548 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.043677 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.043868 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.043998 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.044191 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.044319 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.044521 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.044658 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.044832 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.044959 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.045140 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.045267 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.045454 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.045596 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.045765 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.045898 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.046069 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.046201 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.046383 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.046517 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.046694 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.046821 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.047002 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.047203 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.047344 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.047483 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.047640 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.047775 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.047957 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.048168 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.048372 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.048507 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.048632 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.048824 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.048953 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.049151 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.049288 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.049478 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.049607 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.049796 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.049932 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.050104 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.050314 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.050444 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.050628 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.050755 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.050962 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.051098 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.051293 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.051410 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.051618 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.051747 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.051934 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.052075 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.052234 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.052360 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.052544 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.052672 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.052851 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.052978 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.053153 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.053280 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.053458 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.053584 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.053761 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.053898 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.054060 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.054187 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.054378 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.054504 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.054683 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.054817 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.054984 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.055117 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.055869 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.056051 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.056195 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.056329 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.056461 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.056766 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.056893 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.057073 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.057314 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.057445 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.057658 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.057784 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.057968 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.058096 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.058275 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.058404 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.058594 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.058728 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.058901 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.059070 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.059276 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.059463 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.059591 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.059814 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.059948 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.060126 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.060261 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.060432 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.060562 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.060749 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.060876 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.061060 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.061188 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.061382 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.061511 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.061694 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.061829 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.062005 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.062179 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.062351 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.062526 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.062654 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.062879 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.063209 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.063341 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.063546 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.063675 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.063865 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.063993 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.064206 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.064336 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.064546 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.064674 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.064854 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.064994 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.065160 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.065288 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.065466 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.065594 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.065789 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.065925 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.066101 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.066257 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.066412 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.066607 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.066736 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.066953 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.067082 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.067333 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.067472 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.067683 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.067807 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.068036 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.068165 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.068383 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.068511 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.068736 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.068865 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.069076 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.069203 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.069417 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.069544 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.069737 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.069892 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.070055 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.070191 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.070370 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.070498 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.070685 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.070850 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.071148 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.071278 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.071521 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.071639 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.071874 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.072016 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.072263 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.072393 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.072619 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.072754 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.073010 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.073244 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.073372 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.073627 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.073754 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.073987 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.074151 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.074369 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.074497 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.074748 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.074878 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.075097 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.075254 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.075466 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.075594 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.075813 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.075941 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.076186 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.076323 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.076565 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.076700 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.076942 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.077092 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.077316 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.077454 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.077667 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.077802 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.078026 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.078154 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.078403 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.078533 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.078838 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.078964 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.079306 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.079474 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.079707 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.079844 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.080066 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.080193 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.080474 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.080601 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.080850 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.080981 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.081207 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.081334 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.081562 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.081704 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.081918 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.082079 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.082269 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.082484 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.082611 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.082832 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.082960 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.083162 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.083491 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.083617 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.083807 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.083947 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.084134 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.084262 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.084448 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.084583 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.084770 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.084906 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.085075 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.085228 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.085391 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.085547 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.085704 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.085870 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.086019 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.086195 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.086353 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.087091 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.087289 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.087652 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.087785 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.087971 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.088204 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.088336 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.088601 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.088730 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.088926 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.089175 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.089312 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.089479 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.089618 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.089792 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.089920 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.090101 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.090233 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.090416 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.090546 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.090758 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.090885 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.091072 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.091258 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.091402 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.091530 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.091705 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.091834 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.092016 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.092144 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.092343 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.092472 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.092654 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.092780 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.092959 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.093085 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.093271 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.093405 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.093585 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.093711 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.093904 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.094040 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.094215 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.094340 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.094528 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.094657 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.094837 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.094972 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.095171 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.095301 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.095487 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.095614 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.095794 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.095929 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.096100 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.096227 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.096412 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.096538 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.096721 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.096856 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.097041 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.097171 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.097361 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.097486 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.097676 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.097809 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.097996 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.098123 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.098305 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.098431 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.098626 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.098755 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.098936 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.099063 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.099283 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.099413 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.099547 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 30 15:58:48.099671 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.099906 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.100218 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.100551 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.100864 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.101176 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.101532 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.101798 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.102654 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.103030 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.103384 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.103711 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.104020 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.104346 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.104664 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.104985 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.105300 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.105613 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.105940 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.106252 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.106568 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.106878 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.107219 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.107538 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.107851 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.108177 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.108500 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.108824 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.109150 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.109505 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.109818 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.110160 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.110485 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 15:58:48.110729 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 30 15:58:48.122530 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG oslo_db.sqlalchemy.engines [None req-8fb9119a-f273-42bc-a0b8-36ede3d0f234 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 15:58:48.132685 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG oslo_db.sqlalchemy.engines [None req-2c6271c0-b998-4cf3-b36e-59ca4d6c3a16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 15:58:48.202048 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.context [None req-8fb9119a-f273-42bc-a0b8-36ede3d0f234 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ef005b1d-69a0-4b69-b2a9-e8f27f5362c8(cell1) {{(pid=92479) load_cells /opt/stack/nova/nova/context.py:464}} Jul 30 15:58:48.206311 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG oslo_concurrency.lockutils [None req-8fb9119a-f273-42bc-a0b8-36ede3d0f234 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 15:58:48.207974 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG oslo_concurrency.lockutils [None req-8fb9119a-f273-42bc-a0b8-36ede3d0f234 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 15:58:48.208798 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG oslo_concurrency.lockutils [None req-8fb9119a-f273-42bc-a0b8-36ede3d0f234 None None] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 15:58:48.209287 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.context [None req-2c6271c0-b998-4cf3-b36e-59ca4d6c3a16 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ef005b1d-69a0-4b69-b2a9-e8f27f5362c8(cell1) {{(pid=92478) load_cells /opt/stack/nova/nova/context.py:464}} Jul 30 15:58:48.210745 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG oslo_concurrency.lockutils [None req-8fb9119a-f273-42bc-a0b8-36ede3d0f234 None None] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 15:58:48.214151 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG oslo_concurrency.lockutils [None req-2c6271c0-b998-4cf3-b36e-59ca4d6c3a16 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 15:58:48.215787 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG oslo_concurrency.lockutils [None req-2c6271c0-b998-4cf3-b36e-59ca4d6c3a16 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 15:58:48.216602 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG oslo_concurrency.lockutils [None req-2c6271c0-b998-4cf3-b36e-59ca4d6c3a16 None None] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 15:58:48.218562 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG oslo_concurrency.lockutils [None req-2c6271c0-b998-4cf3-b36e-59ca4d6c3a16 None None] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 15:58:48.221660 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG oslo_db.sqlalchemy.engines [None req-8fb9119a-f273-42bc-a0b8-36ede3d0f234 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 15:58:48.224190 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG oslo_db.sqlalchemy.engines [None req-8fb9119a-f273-42bc-a0b8-36ede3d0f234 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 15:58:48.231225 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG oslo_db.sqlalchemy.engines [None req-2c6271c0-b998-4cf3-b36e-59ca4d6c3a16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 15:58:48.234664 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG oslo_db.sqlalchemy.engines [None req-2c6271c0-b998-4cf3-b36e-59ca4d6c3a16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 15:58:48.582192 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG oslo_db.sqlalchemy.engines [None req-8fb9119a-f273-42bc-a0b8-36ede3d0f234 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 15:58:48.591829 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG oslo_db.sqlalchemy.engines [None req-2c6271c0-b998-4cf3-b36e-59ca4d6c3a16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 15:58:48.929822 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: WARNING keystonemiddleware.auth_token [None req-2c6271c0-b998-4cf3-b36e-59ca4d6c3a16 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 15:58:48.930955 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: WARNING keystonemiddleware.auth_token [None req-8fb9119a-f273-42bc-a0b8-36ede3d0f234 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 15:58:48.936987 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: WARNING keystonemiddleware.auth_token [None req-8fb9119a-f273-42bc-a0b8-36ede3d0f234 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 15:58:48.937663 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: WARNING keystonemiddleware.auth_token [None req-2c6271c0-b998-4cf3-b36e-59ca4d6c3a16 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 15:58:49.283749 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: WARNING keystonemiddleware.auth_token [None req-8fb9119a-f273-42bc-a0b8-36ede3d0f234 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 15:58:49.284240 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: WARNING keystonemiddleware.auth_token [None req-2c6271c0-b998-4cf3-b36e-59ca4d6c3a16 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 15:58:49.289062 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: WARNING keystonemiddleware.auth_token [None req-8fb9119a-f273-42bc-a0b8-36ede3d0f234 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 15:58:49.289618 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: WARNING keystonemiddleware.auth_token [None req-2c6271c0-b998-4cf3-b36e-59ca4d6c3a16 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 15:58:49.294485 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dcda64f9c0 pid: 92479 (default app) Jul 30 15:58:49.295245 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dcda64f9c0 pid: 92478 (default app) Jul 30 15:58:49.296638 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-8fb9119a-f273-42bc-a0b8-36ede3d0f234 None None] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 15:58:49.297850 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-8fb9119a-f273-42bc-a0b8-36ede3d0f234 None None] 10.222.0.37 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001803 Jul 30 15:58:49.298259 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 1/1] 10.222.0.37 () {50 vars in 789 bytes} [Fri Jul 30 15:58:49 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:00:09.219400 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-2c6271c0-b998-4cf3-b36e-59ca4d6c3a16 None None] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:00:09.220620 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-2c6271c0-b998-4cf3-b36e-59ca4d6c3a16 None None] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002030 Jul 30 16:00:09.221028 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 1/2] 10.222.0.37 () {54 vars in 931 bytes} [Fri Jul 30 16:00:09 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:00:09.643763 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-4e470710-248a-451e-a00f-20e6cc788afa admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:00:09.673832 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-4e470710-248a-451e-a00f-20e6cc788afa admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.446065 Jul 30 16:00:09.674533 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 2/3] 10.222.0.37 () {60 vars in 1292 bytes} [Fri Jul 30 16:00:09 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:00:11.869405 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-2c6271c0-b998-4cf3-b36e-59ca4d6c3a16 None None] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:00:11.870590 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-2c6271c0-b998-4cf3-b36e-59ca4d6c3a16 None None] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001671 Jul 30 16:00:11.871429 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 2/4] 10.222.0.37 () {54 vars in 931 bytes} [Fri Jul 30 16:00:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:00:11.938944 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-a1710ed0-701f-4261-b3c9-5bf7c74e139b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:11.958235 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:00:11.958235 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: warnings.warn(msg) Jul 30 16:00:11.986763 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-a1710ed0-701f-4261-b3c9-5bf7c74e139b admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107910 Jul 30 16:00:11.991216 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 3/5] 10.222.0.37 () {64 vars in 1283 bytes} [Fri Jul 30 16:00:11 2021] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:00:12.206055 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-3e075c68-1716-4d4a-be1c-6ab9473a6ec8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:12.208380 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:00:12.208380 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: warnings.warn(msg) Jul 30 16:00:12.256245 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-3e075c68-1716-4d4a-be1c-6ab9473a6ec8 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.259435 Jul 30 16:00:12.267685 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 3/6] 10.222.0.37 () {64 vars in 1336 bytes} [Fri Jul 30 16:00:11 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:00:14.506374 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-a1710ed0-701f-4261-b3c9-5bf7c74e139b admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:00:14.507506 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-a1710ed0-701f-4261-b3c9-5bf7c74e139b admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001766 Jul 30 16:00:14.508576 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 4/7] 10.222.0.37 () {54 vars in 931 bytes} [Fri Jul 30 16:00:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:00:14.611305 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-4316f2d4-cbcd-477e-b896-ebbe4b727476 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0, "vcpus": 1}} {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:14.633473 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:00:14.633473 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: warnings.warn(msg) Jul 30 16:00:14.652479 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-4316f2d4-cbcd-477e-b896-ebbe4b727476 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137437 Jul 30 16:00:14.653041 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 4/8] 10.222.0.37 () {64 vars in 1283 bytes} [Fri Jul 30 16:00:14 2021] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:00:14.665862 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-fd9a42e3-4a69-4075-a66a-e93d3b83ff5f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:14.667472 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:00:14.667472 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: warnings.warn(msg) Jul 30 16:00:14.698791 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-fd9a42e3-4a69-4075-a66a-e93d3b83ff5f admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037236 Jul 30 16:00:14.699626 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 5/9] 10.222.0.37 () {64 vars in 1336 bytes} [Fri Jul 30 16:00:14 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:00:16.895611 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-4316f2d4-cbcd-477e-b896-ebbe4b727476 admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:00:16.896633 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-4316f2d4-cbcd-477e-b896-ebbe4b727476 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jul 30 16:00:16.897055 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 5/10] 10.222.0.37 () {54 vars in 931 bytes} [Fri Jul 30 16:00:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:00:16.955985 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-c67889a2-91e7-4b2a-b6eb-0cbb98286366 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "name": "ds1G", "id": "d2", "disk": 10, "ram": 1024, "rxtx_factor": 1.0}} {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:16.976103 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-c67889a2-91e7-4b2a-b6eb-0cbb98286366 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072270 Jul 30 16:00:16.977381 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 6/11] 10.222.0.37 () {64 vars in 1283 bytes} [Fri Jul 30 16:00:16 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:00:16.989633 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-2dc99b08-0ac4-4f60-81ae-eb549b7ac6a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:17.015323 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-2dc99b08-0ac4-4f60-81ae-eb549b7ac6a6 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029282 Jul 30 16:00:17.015908 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 6/12] 10.222.0.37 () {64 vars in 1336 bytes} [Fri Jul 30 16:00:16 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:00:19.252558 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-c67889a2-91e7-4b2a-b6eb-0cbb98286366 admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:00:19.253718 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-c67889a2-91e7-4b2a-b6eb-0cbb98286366 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001657 Jul 30 16:00:19.254240 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 7/13] 10.222.0.37 () {54 vars in 931 bytes} [Fri Jul 30 16:00:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:00:19.327459 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-121eebbf-7a8c-4b5c-901e-7691be34b9fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "rxtx_factor": 1.0, "id": "d3"}} {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:19.346769 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-121eebbf-7a8c-4b5c-901e-7691be34b9fc admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.084853 Jul 30 16:00:19.347375 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 7/14] 10.222.0.37 () {64 vars in 1283 bytes} [Fri Jul 30 16:00:19 2021] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:00:19.359817 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-ad7951b4-f863-4ded-98e2-95f4613c1a02 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:19.383515 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-ad7951b4-f863-4ded-98e2-95f4613c1a02 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026905 Jul 30 16:00:19.384134 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 8/15] 10.222.0.37 () {64 vars in 1336 bytes} [Fri Jul 30 16:00:19 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:00:21.593933 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-121eebbf-7a8c-4b5c-901e-7691be34b9fc admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:00:21.594940 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-121eebbf-7a8c-4b5c-901e-7691be34b9fc admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 30 16:00:21.600674 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 8/16] 10.222.0.37 () {54 vars in 931 bytes} [Fri Jul 30 16:00:21 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:00:21.653611 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-c4291a60-f06a-4a08-8272-d5cada5b9eb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 4096, "name": "ds4G", "id": "d4", "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:21.672868 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-c4291a60-f06a-4a08-8272-d5cada5b9eb9 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070343 Jul 30 16:00:21.673618 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 9/17] 10.222.0.37 () {64 vars in 1283 bytes} [Fri Jul 30 16:00:21 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:00:21.685796 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-7cb2dee9-72e1-4e94-aaef-ad64f39c8bef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:21.709146 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-7cb2dee9-72e1-4e94-aaef-ad64f39c8bef admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026914 Jul 30 16:00:21.715763 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 9/18] 10.222.0.37 () {64 vars in 1336 bytes} [Fri Jul 30 16:00:21 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:00:23.959227 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-c4291a60-f06a-4a08-8272-d5cada5b9eb9 admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:00:23.960309 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-c4291a60-f06a-4a08-8272-d5cada5b9eb9 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jul 30 16:00:23.960737 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 10/19] 10.222.0.37 () {54 vars in 931 bytes} [Fri Jul 30 16:00:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:00:24.023640 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-38082141-444d-4051-9978-a0aa6967017f admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:00:24.047981 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-38082141-444d-4051-9978-a0aa6967017f admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080498 Jul 30 16:00:24.051482 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 10/20] 10.222.0.37 () {60 vars in 1292 bytes} [Fri Jul 30 16:00:23 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:00:26.341204 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-c4291a60-f06a-4a08-8272-d5cada5b9eb9 admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:00:26.342211 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-c4291a60-f06a-4a08-8272-d5cada5b9eb9 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 30 16:00:26.342621 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 11/21] 10.222.0.37 () {54 vars in 931 bytes} [Fri Jul 30 16:00:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:00:26.420839 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-3105629a-f047-4c91-9d7d-f7b44be4bca2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:26.440147 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-3105629a-f047-4c91-9d7d-f7b44be4bca2 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.091083 Jul 30 16:00:26.440695 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 11/22] 10.222.0.37 () {64 vars in 1283 bytes} [Fri Jul 30 16:00:26 2021] POST /compute/v2.1/flavors => generated 402 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:00:26.464846 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-b28e49d7-9ffe-4af5-a78c-0c69f8de9cdb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:26.490299 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-b28e49d7-9ffe-4af5-a78c-0c69f8de9cdb admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029960 Jul 30 16:00:26.490891 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 12/23] 10.222.0.37 () {64 vars in 1333 bytes} [Fri Jul 30 16:00:26 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:00:28.945616 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-3105629a-f047-4c91-9d7d-f7b44be4bca2 admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:00:28.947067 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-3105629a-f047-4c91-9d7d-f7b44be4bca2 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002636 Jul 30 16:00:28.947616 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 12/24] 10.222.0.37 () {54 vars in 931 bytes} [Fri Jul 30 16:00:28 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:00:29.009376 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-7a5ebd17-d174-4389-939a-ae9de84bb59c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:29.032771 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-7a5ebd17-d174-4389-939a-ae9de84bb59c admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078085 Jul 30 16:00:29.033527 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 13/25] 10.222.0.37 () {64 vars in 1283 bytes} [Fri Jul 30 16:00:28 2021] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:00:29.049763 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-df2d9be7-6b2d-441e-99e9-20fbcd133873 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:29.078166 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-df2d9be7-6b2d-441e-99e9-20fbcd133873 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033021 Jul 30 16:00:29.078822 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 13/26] 10.222.0.37 () {64 vars in 1333 bytes} [Fri Jul 30 16:00:29 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:00:31.441206 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-7a5ebd17-d174-4389-939a-ae9de84bb59c admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:00:31.442272 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-7a5ebd17-d174-4389-939a-ae9de84bb59c admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jul 30 16:00:31.442683 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 14/27] 10.222.0.37 () {54 vars in 931 bytes} [Fri Jul 30 16:00:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:00:31.499096 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-983640a2-219d-4c75-b013-239be60ce7cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "id": "3"}} {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:31.517381 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-983640a2-219d-4c75-b013-239be60ce7cb admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.067482 Jul 30 16:00:31.517918 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 14/28] 10.222.0.37 () {64 vars in 1283 bytes} [Fri Jul 30 16:00:31 2021] POST /compute/v2.1/flavors => generated 406 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:00:31.530978 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-13b6961b-72a0-4d64-b5cd-87db8e9c150c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:31.553274 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-13b6961b-72a0-4d64-b5cd-87db8e9c150c admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025817 Jul 30 16:00:31.553778 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 15/29] 10.222.0.37 () {64 vars in 1333 bytes} [Fri Jul 30 16:00:31 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:00:33.730851 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-983640a2-219d-4c75-b013-239be60ce7cb admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:00:33.732006 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-983640a2-219d-4c75-b013-239be60ce7cb admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Jul 30 16:00:33.732416 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 15/30] 10.222.0.37 () {54 vars in 931 bytes} [Fri Jul 30 16:00:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:00:33.790968 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-b475041c-ef67-4a95-afbd-6a744b3bfd6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "vcpus": 4, "name": "m1.large", "disk": 80, "ram": 8192}} {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:33.813342 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-b475041c-ef67-4a95-afbd-6a744b3bfd6a admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074202 Jul 30 16:00:33.813901 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 16/31] 10.222.0.37 () {64 vars in 1283 bytes} [Fri Jul 30 16:00:33 2021] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:00:33.826073 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-3e02f3c2-d83b-4336-9044-11d86cb078e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:33.849434 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-3e02f3c2-d83b-4336-9044-11d86cb078e0 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026921 Jul 30 16:00:33.850190 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 16/32] 10.222.0.37 () {64 vars in 1333 bytes} [Fri Jul 30 16:00:33 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:00:36.068765 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-b475041c-ef67-4a95-afbd-6a744b3bfd6a admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:00:36.069823 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-b475041c-ef67-4a95-afbd-6a744b3bfd6a admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 30 16:00:36.070287 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 17/33] 10.222.0.37 () {54 vars in 931 bytes} [Fri Jul 30 16:00:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:00:36.128721 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-526a684c-278b-4989-933d-c8729d961f50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:36.147046 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-526a684c-278b-4989-933d-c8729d961f50 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.070357 Jul 30 16:00:36.147642 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 17/34] 10.222.0.37 () {64 vars in 1283 bytes} [Fri Jul 30 16:00:36 2021] POST /compute/v2.1/flavors => generated 408 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:00:36.160610 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-be2b8c88-651b-4510-b5eb-53c562e9084f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:00:36.184054 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-be2b8c88-651b-4510-b5eb-53c562e9084f admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027111 Jul 30 16:00:36.184713 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 18/35] 10.222.0.37 () {64 vars in 1333 bytes} [Fri Jul 30 16:00:36 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:01:15.796860 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-526a684c-278b-4989-933d-c8729d961f50 admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:15.797866 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-526a684c-278b-4989-933d-c8729d961f50 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 30 16:01:15.798264 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 18/36] 10.222.0.37 () {54 vars in 931 bytes} [Fri Jul 30 16:01:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:01:15.854158 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-63997378-53f9-4478-943e-877e425c41a8 admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:15.870421 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-63997378-53f9-4478-943e-877e425c41a8 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.065163 Jul 30 16:01:15.870947 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 19/37] 10.222.0.37 () {60 vars in 1292 bytes} [Fri Jul 30 16:01:15 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:01:17.301260 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-526a684c-278b-4989-933d-c8729d961f50 admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:17.302266 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-526a684c-278b-4989-933d-c8729d961f50 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 30 16:01:17.302665 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 19/38] 10.222.0.37 () {56 vars in 1075 bytes} [Fri Jul 30 16:01:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:01:17.489261 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-5852a248-3d78-448b-aeaf-492ee3641fa0 admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:17.495139 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.wsgi [None req-5852a248-3d78-448b-aeaf-492ee3641fa0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 30 16:01:17.495720 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-5852a248-3d78-448b-aeaf-492ee3641fa0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:01:17.496507 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-5852a248-3d78-448b-aeaf-492ee3641fa0 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.055541 Jul 30 16:01:17.497014 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 20/39] 10.222.0.37 () {60 vars in 1191 bytes} [Fri Jul 30 16:01:17 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 30 16:01:17.506674 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-02aa038f-3c9b-43e8-aa0f-d5c273157073 admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:17.527794 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-02aa038f-3c9b-43e8-aa0f-d5c273157073 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024637 Jul 30 16:01:17.528266 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 20/40] 10.222.0.37 () {60 vars in 1211 bytes} [Fri Jul 30 16:01:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:01:17.538051 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-2c2ef6de-c3e2-4b31-aac8-a17d7848966d admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:17.559165 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-2c2ef6de-c3e2-4b31-aac8-a17d7848966d admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024592 Jul 30 16:01:17.559684 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 21/41] 10.222.0.37 () {60 vars in 1211 bytes} [Fri Jul 30 16:01:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:01:17.569387 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-e455e4da-bad5-4607-b80d-b00215888d80 admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:17.575165 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.wsgi [None req-e455e4da-bad5-4607-b80d-b00215888d80 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 30 16:01:17.575732 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-e455e4da-bad5-4607-b80d-b00215888d80 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:01:17.576517 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-e455e4da-bad5-4607-b80d-b00215888d80 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.010601 Jul 30 16:01:17.578269 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 21/42] 10.222.0.37 () {60 vars in 1191 bytes} [Fri Jul 30 16:01:17 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 30 16:01:18.932520 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-2c2ef6de-c3e2-4b31-aac8-a17d7848966d admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:18.933535 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-2c2ef6de-c3e2-4b31-aac8-a17d7848966d admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 30 16:01:18.933935 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 22/43] 10.222.0.37 () {56 vars in 1075 bytes} [Fri Jul 30 16:01:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:01:19.122643 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-47f5c8f3-6457-4dd4-b545-b90ff51964d2 admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:19.127811 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.wsgi [None req-47f5c8f3-6457-4dd4-b545-b90ff51964d2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 30 16:01:19.128375 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-47f5c8f3-6457-4dd4-b545-b90ff51964d2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:01:19.129161 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-47f5c8f3-6457-4dd4-b545-b90ff51964d2 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.056667 Jul 30 16:01:19.129659 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 22/44] 10.222.0.37 () {60 vars in 1191 bytes} [Fri Jul 30 16:01:19 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 30 16:01:19.139718 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-42a49f1f-87a9-4d42-8c24-091ad37215fc admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:19.153234 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-42a49f1f-87a9-4d42-8c24-091ad37215fc admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017076 Jul 30 16:01:19.153745 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 23/45] 10.222.0.37 () {60 vars in 1211 bytes} [Fri Jul 30 16:01:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:01:19.163390 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-8e077441-e038-4897-bff7-6a483e65f5aa admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:19.177146 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-8e077441-e038-4897-bff7-6a483e65f5aa admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017087 Jul 30 16:01:19.177610 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 23/46] 10.222.0.37 () {60 vars in 1211 bytes} [Fri Jul 30 16:01:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:01:19.189154 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-80ece850-a96f-48d4-b4a1-0c28eaa7ddae admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:19.198297 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.wsgi [None req-80ece850-a96f-48d4-b4a1-0c28eaa7ddae admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 30 16:01:19.199021 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-80ece850-a96f-48d4-b4a1-0c28eaa7ddae admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:01:19.199909 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-80ece850-a96f-48d4-b4a1-0c28eaa7ddae admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.015992 Jul 30 16:01:19.200403 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 24/47] 10.222.0.37 () {60 vars in 1191 bytes} [Fri Jul 30 16:01:19 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 30 16:01:20.541471 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-8e077441-e038-4897-bff7-6a483e65f5aa admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:20.542548 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-8e077441-e038-4897-bff7-6a483e65f5aa admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 30 16:01:20.542951 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 24/48] 10.222.0.37 () {56 vars in 1075 bytes} [Fri Jul 30 16:01:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:01:20.730805 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-c71eb4c6-bac8-400a-9d80-146ec6e15a7a admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:20.737701 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.wsgi [None req-c71eb4c6-bac8-400a-9d80-146ec6e15a7a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 30 16:01:20.738277 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-c71eb4c6-bac8-400a-9d80-146ec6e15a7a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:01:20.739064 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-c71eb4c6-bac8-400a-9d80-146ec6e15a7a admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.058047 Jul 30 16:01:20.739714 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 25/49] 10.222.0.37 () {60 vars in 1194 bytes} [Fri Jul 30 16:01:20 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 30 16:01:20.749531 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-8fcb26b0-0032-4b08-9fa4-6258ec91ff16 admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:20.763452 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-8fcb26b0-0032-4b08-9fa4-6258ec91ff16 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017432 Jul 30 16:01:20.763967 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 25/50] 10.222.0.37 () {60 vars in 1211 bytes} [Fri Jul 30 16:01:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:01:20.774100 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-a3f8b526-ce97-45f6-82ca-f6493583d74e admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:20.787726 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-a3f8b526-ce97-45f6-82ca-f6493583d74e admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017597 Jul 30 16:01:20.788278 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 26/51] 10.222.0.37 () {60 vars in 1211 bytes} [Fri Jul 30 16:01:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:01:20.798414 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-4643b996-9096-4750-8d9c-59b7be64a54d admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:20.803564 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.wsgi [None req-4643b996-9096-4750-8d9c-59b7be64a54d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 30 16:01:20.804326 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-4643b996-9096-4750-8d9c-59b7be64a54d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:01:20.805121 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-4643b996-9096-4750-8d9c-59b7be64a54d admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.010286 Jul 30 16:01:20.805609 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 26/52] 10.222.0.37 () {60 vars in 1194 bytes} [Fri Jul 30 16:01:20 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 30 16:01:22.147383 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-a3f8b526-ce97-45f6-82ca-f6493583d74e admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:22.148414 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-a3f8b526-ce97-45f6-82ca-f6493583d74e admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 30 16:01:22.148807 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 27/53] 10.222.0.37 () {56 vars in 1075 bytes} [Fri Jul 30 16:01:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:01:22.335704 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-ed29dde5-2fc8-4c6e-81ce-4618fd1c22ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:01:22.354482 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-ed29dde5-2fc8-4c6e-81ce-4618fd1c22ba admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.068272 Jul 30 16:01:22.355018 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 27/54] 10.222.0.37 () {64 vars in 1236 bytes} [Fri Jul 30 16:01:22 2021] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:01:23.703564 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-a3f8b526-ce97-45f6-82ca-f6493583d74e admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:23.704595 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-a3f8b526-ce97-45f6-82ca-f6493583d74e admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 30 16:01:23.704992 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 28/55] 10.222.0.37 () {56 vars in 1075 bytes} [Fri Jul 30 16:01:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:01:23.892270 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-01364ff3-94df-4a7a-96dc-e14be6eb81b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:01:23.909830 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-01364ff3-94df-4a7a-96dc-e14be6eb81b3 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.066248 Jul 30 16:01:23.910353 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 28/56] 10.222.0.37 () {64 vars in 1236 bytes} [Fri Jul 30 16:01:23 2021] POST /compute/v2.1/flavors => generated 405 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:01:25.274513 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-a3f8b526-ce97-45f6-82ca-f6493583d74e admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:25.278747 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-a3f8b526-ce97-45f6-82ca-f6493583d74e admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 30 16:01:25.279227 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 29/57] 10.222.0.37 () {56 vars in 1075 bytes} [Fri Jul 30 16:01:25 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:01:25.476410 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-b29b0f89-2db1-4b65-aaa4-af08e389b06e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:01:25.494511 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-b29b0f89-2db1-4b65-aaa4-af08e389b06e admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.067762 Jul 30 16:01:25.494983 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 29/58] 10.222.0.37 () {64 vars in 1236 bytes} [Fri Jul 30 16:01:25 2021] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:01:27.011113 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-a3f8b526-ce97-45f6-82ca-f6493583d74e admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:27.012209 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-a3f8b526-ce97-45f6-82ca-f6493583d74e admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005519 Jul 30 16:01:27.012619 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 30/59] 10.222.0.37 () {56 vars in 1075 bytes} [Fri Jul 30 16:01:27 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:01:27.201879 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-3cf02d41-4245-475b-9a39-bac26e278bd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:01:27.218840 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-3cf02d41-4245-475b-9a39-bac26e278bd8 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.066018 Jul 30 16:01:27.219627 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 30/60] 10.222.0.37 () {64 vars in 1236 bytes} [Fri Jul 30 16:01:27 2021] POST /compute/v2.1/flavors => generated 409 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:01:28.601019 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-a3f8b526-ce97-45f6-82ca-f6493583d74e admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:28.602111 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-a3f8b526-ce97-45f6-82ca-f6493583d74e admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Jul 30 16:01:28.602514 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 31/61] 10.222.0.37 () {56 vars in 1075 bytes} [Fri Jul 30 16:01:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:01:28.791376 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-d34ce415-250b-4bcf-ba40-e03d8aa7bc9e admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:01:28.810652 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-d34ce415-250b-4bcf-ba40-e03d8aa7bc9e admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.069948 Jul 30 16:01:28.811119 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 31/62] 10.222.0.37 () {60 vars in 1203 bytes} [Fri Jul 30 16:01:28 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:02:15.417725 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-a3f8b526-ce97-45f6-82ca-f6493583d74e admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:02:15.418732 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-a3f8b526-ce97-45f6-82ca-f6493583d74e admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jul 30 16:02:15.419145 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 32/63] 10.222.0.37 () {54 vars in 931 bytes} [Fri Jul 30 16:02:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:02:15.474770 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-d9e1d26d-34ee-48bd-9183-45cecab98acd admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:02:15.493578 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-d9e1d26d-34ee-48bd-9183-45cecab98acd admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.068016 Jul 30 16:02:15.494121 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 32/64] 10.222.0.37 () {60 vars in 1292 bytes} [Fri Jul 30 16:02:15 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:02:15.516434 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-673649bf-c4f1-4e8f-972e-12102e2fbc03 admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:02:15.524919 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-673649bf-c4f1-4e8f-972e-12102e2fbc03 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011985 Jul 30 16:02:15.525426 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 33/65] 10.222.0.37 () {60 vars in 1283 bytes} [Fri Jul 30 16:02:15 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:02:15.536653 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-58fbbdba-0ed2-4a08-a4c0-2f73d4bbd867 admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:02:15.544140 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-58fbbdba-0ed2-4a08-a4c0-2f73d4bbd867 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010868 Jul 30 16:02:15.544591 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 33/66] 10.222.0.37 () {60 vars in 1286 bytes} [Fri Jul 30 16:02:15 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:02:15.555773 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-51a5378f-b325-4b5e-894d-2de7abad4fdf admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:02:15.562962 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-51a5378f-b325-4b5e-894d-2de7abad4fdf admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010702 Jul 30 16:02:15.563509 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 34/67] 10.222.0.37 () {60 vars in 1286 bytes} [Fri Jul 30 16:02:15 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:02:15.578608 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-126f4bd6-fc25-4986-beba-9d71c73a4f45 admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:02:15.587375 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-126f4bd6-fc25-4986-beba-9d71c73a4f45 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014653 Jul 30 16:02:15.587906 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 34/68] 10.222.0.37 () {60 vars in 1283 bytes} [Fri Jul 30 16:02:15 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:03:35.307778 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-039495fa-ad42-4098-a24a-a014ada2be80 tempest-verify_tempest_config-793760385 tempest-verify_tempest_config-793760385-project] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:03:35.309872 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-039495fa-ad42-4098-a24a-a014ada2be80 tempest-verify_tempest_config-793760385 tempest-verify_tempest_config-793760385-project] 10.222.0.37 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.111201 Jul 30 16:03:35.310509 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 35/69] 10.222.0.37 () {58 vars in 1134 bytes} [Fri Jul 30 16:03:35 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:05:08.309187 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-126f4bd6-fc25-4986-beba-9d71c73a4f45 admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:05:08.310200 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-126f4bd6-fc25-4986-beba-9d71c73a4f45 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 30 16:05:08.310596 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 35/70] 10.222.0.37 () {56 vars in 1075 bytes} [Fri Jul 30 16:05:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:05:08.562518 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-fce65d16-d5f6-41d7-bb2f-d568c0e6e3fe admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:05:08.563747 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:05:08.563747 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: warnings.warn(msg) Jul 30 16:05:08.565282 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG oslo_concurrency.lockutils [None req-fce65d16-d5f6-41d7-bb2f-d568c0e6e3fe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:05:08.565728 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG oslo_concurrency.lockutils [None req-fce65d16-d5f6-41d7-bb2f-d568c0e6e3fe admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:05:08.566519 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG oslo_concurrency.lockutils [None req-fce65d16-d5f6-41d7-bb2f-d568c0e6e3fe admin admin] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:05:08.566981 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG oslo_concurrency.lockutils [None req-fce65d16-d5f6-41d7-bb2f-d568c0e6e3fe admin admin] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:05:08.605988 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-fce65d16-d5f6-41d7-bb2f-d568c0e6e3fe admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.154723 Jul 30 16:05:08.606546 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 36/71] 10.222.0.37 () {60 vars in 1194 bytes} [Fri Jul 30 16:05:08 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:05:09.965188 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: DEBUG nova.api.openstack.wsgi [None req-126f4bd6-fc25-4986-beba-9d71c73a4f45 admin admin] Calling method '>' {{(pid=92478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:05:09.966233 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: INFO nova.api.openstack.requestlog [None req-126f4bd6-fc25-4986-beba-9d71c73a4f45 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 30 16:05:09.966631 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: [pid: 92478|app: 0|req: 36/72] 10.222.0.37 () {56 vars in 1075 bytes} [Fri Jul 30 16:05:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:05:10.158426 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG nova.api.openstack.wsgi [None req-1ae07033-a6af-4740-af11-405434889879 admin admin] Calling method '>' {{(pid=92479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:05:10.160134 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:05:10.160134 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: warnings.warn(msg) Jul 30 16:05:10.161657 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG oslo_concurrency.lockutils [None req-1ae07033-a6af-4740-af11-405434889879 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:05:10.162093 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG oslo_concurrency.lockutils [None req-1ae07033-a6af-4740-af11-405434889879 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:05:10.162871 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG oslo_concurrency.lockutils [None req-1ae07033-a6af-4740-af11-405434889879 admin admin] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:05:10.163324 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: DEBUG oslo_concurrency.lockutils [None req-1ae07033-a6af-4740-af11-405434889879 admin admin] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:05:10.184107 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: INFO nova.api.openstack.requestlog [None req-1ae07033-a6af-4740-af11-405434889879 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.074747 Jul 30 16:05:10.184648 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: [pid: 92479|app: 0|req: 37/73] 10.222.0.37 () {60 vars in 1194 bytes} [Fri Jul 30 16:05:10 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:06:05.993026 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: Fri Jul 30 16:06:05 2021 - graceful shutdown triggered... Jul 30 16:06:05.993143 dv-cinder-803046-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 30 16:06:05.994083 dv-cinder-803046-3-iscsi devstack@n-api.service[92478]: Gracefully killing worker 1 (pid: 92478)... Jul 30 16:06:05.994476 dv-cinder-803046-3-iscsi devstack@n-api.service[92479]: Gracefully killing worker 2 (pid: 92479)... Jul 30 16:06:06.995158 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: worker 1 buried after 1 seconds Jul 30 16:06:06.995570 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: worker 2 buried after 1 seconds Jul 30 16:06:06.995570 dv-cinder-803046-3-iscsi devstack@n-api.service[92477]: goodbye to uWSGI. Jul 30 16:06:06.996678 dv-cinder-803046-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 30 16:06:06.997221 dv-cinder-803046-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 30 16:06:07.000059 dv-cinder-803046-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 30 16:06:07.010252 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 30 16:06:07.012523 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 30 16:06:07 2021] *** Jul 30 16:06:07.012523 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 30 16:06:07.012523 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 30 16:06:07.012523 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: nodename: dv-cinder-803046-3-iscsi Jul 30 16:06:07.012523 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: machine: x86_64 Jul 30 16:06:07.012523 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: clock source: unix Jul 30 16:06:07.012523 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: pcre jit disabled Jul 30 16:06:07.012523 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: detected number of CPU cores: 4 Jul 30 16:06:07.012523 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: current working directory: / Jul 30 16:06:07.012523 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: detected binary path: /usr/bin/uwsgi-core Jul 30 16:06:07.012523 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: your processes number limit is 47680 Jul 30 16:06:07.013300 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: your memory page size is 4096 bytes Jul 30 16:06:07.013300 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: detected max file descriptor number: 2048 Jul 30 16:06:07.013300 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: lock engine: pthread robust mutexes Jul 30 16:06:07.013300 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: thunder lock: enabled Jul 30 16:06:07.013300 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 30 16:06:07.013300 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Jul 30 16:06:07.058764 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: Python main interpreter initialized at 0x5628379d79c0 Jul 30 16:06:07.058764 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: python threads support enabled Jul 30 16:06:07.058764 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: your server socket listen backlog is limited to 100 connections Jul 30 16:06:07.058764 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: your mercy for graceful operations on workers is 90 seconds Jul 30 16:06:07.058764 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: mapped 403077 bytes (393 KB) for 2 cores Jul 30 16:06:07.058764 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: *** Operational MODE: preforking *** Jul 30 16:06:07.058764 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: *** uWSGI is running in multiple interpreter mode *** Jul 30 16:06:07.058764 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: spawned uWSGI master process (pid: 107430) Jul 30 16:06:07.058891 dv-cinder-803046-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 30 16:06:07.067158 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: spawned uWSGI worker 1 (pid: 107452, cores: 1) Jul 30 16:06:07.067158 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: spawned uWSGI worker 2 (pid: 107453, cores: 1) Jul 30 16:06:07.067158 dv-cinder-803046-3-iscsi devstack@n-api.service[107430]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 30 16:06:08.884192 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 16:06:08.884192 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: from cryptography.utils import int_from_bytes Jul 30 16:06:08.884895 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 16:06:08.884895 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: from cryptography.utils import int_from_bytes Jul 30 16:06:08.885796 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 16:06:08.885796 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: from cryptography.utils import int_from_bytes Jul 30 16:06:08.886273 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 16:06:08.886273 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: from cryptography.utils import int_from_bytes Jul 30 16:06:11.434536 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 30 16:06:11.435072 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 30 16:06:11.435413 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 30 16:06:11.435552 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 30 16:06:11.435807 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 30 16:06:11.436205 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.436538 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.436868 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.437195 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.437531 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.437849 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.438180 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.438509 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.438904 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.439728 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.440056 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.440391 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803046-3-iscsi {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.440723 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.441040 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.441358 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.441684 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.441996 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.442326 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.442646 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.443183 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.444626 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.444626 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.444626 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.444626 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.444951 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.445196 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.445529 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.445844 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.446176 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.446492 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.446897 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803046-3-iscsi {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.447252 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.447576 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.447921 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.448326 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.448644 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.448956 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.449300 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.449605 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.449945 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.450259 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.450585 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.450914 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.451265 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.451576 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.451893 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.452229 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.452540 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.452857 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.453171 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.453429 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.453741 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.454070 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.454398 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.454762 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.455022 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.455305 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.455639 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.456021 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.456357 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.456674 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.456989 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.457305 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.457621 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.457949 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.458254 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.458566 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.458893 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.459241 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.459581 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.459901 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.460232 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.460638 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.460898 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.461214 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.461565 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.461892 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.462209 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.462536 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.462928 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.463209 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.463521 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.463838 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.464163 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.464495 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.464808 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.465067 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.465374 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.465687 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.466012 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.466322 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.466635 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.466948 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.467284 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.467598 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.468416 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.468416 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.468746 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.468889 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.469244 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.469410 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.469862 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.470035 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.470580 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.470937 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.471281 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.471602 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.471846 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 30 16:06:11.472285 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 30 16:06:11.472437 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.472437 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.472732 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 30 16:06:11.472885 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.473053 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 30 16:06:11.473294 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.473443 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 30 16:06:11.473858 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.474015 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.474157 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.474298 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.474447 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.474597 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.474748 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.474932 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.475083 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.475258 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.475412 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.475570 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.475711 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.475860 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.476008 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.476277 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.476436 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.476598 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.476748 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.476908 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.477053 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.477200 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.477356 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.477505 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803046-3-iscsi {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.477653 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.477802 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.477956 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.478107 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.478262 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.478405 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.478553 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.478696 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.478859 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.479001 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.479358 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.479632 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.479790 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.479934 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.480075 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.480075 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.480383 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.480628 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.480777 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.480941 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.481091 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.481479 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.481638 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.481788 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.481939 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.482087 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.482238 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.482396 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.482533 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.482827 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.482927 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.483020 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.483115 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.483272 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.483361 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.483517 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.483607 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.483703 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.484083 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803046-3-iscsi {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.484183 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.484268 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.484351 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.484449 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.484537 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.484629 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.484723 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.484816 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.484908 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.485000 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.485092 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.485183 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.485267 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.485356 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.485439 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.485531 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.485614 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.486338 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.486481 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.486675 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.486820 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.486979 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.487074 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.487333 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.487450 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.487651 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.487763 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.487956 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.488047 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.488269 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.488370 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.488586 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.488693 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.488910 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.489009 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.489221 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.489321 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.489534 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.489674 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.489794 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.489902 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.490105 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.490205 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.490429 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.490530 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.490755 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.490846 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.491083 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.491230 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.491438 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.491532 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.491695 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.491786 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.492020 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.492113 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.492355 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.492456 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.492670 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.492763 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.492983 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.493085 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.493295 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.493401 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.493608 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.493708 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.493918 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.494016 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.494231 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.494345 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.494540 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.494696 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.494841 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.494992 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.495163 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.495309 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.495493 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.495638 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.495818 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.495964 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.496113 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.496263 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.496440 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.496599 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.496808 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.496966 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.497114 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.497264 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.497406 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.497554 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.497709 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.497854 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.498006 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.498154 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.498314 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.498455 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.498610 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.498756 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.498903 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.499041 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.499210 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.499302 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.499594 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.499699 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.499850 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.499942 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.500171 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.500273 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.500484 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.500573 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.500795 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.500885 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.501052 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.501155 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.501997 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.502154 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.502320 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.502414 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.502655 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.502758 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.502978 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.503078 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.503326 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.503420 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.503639 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.503744 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.503948 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.504047 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.504320 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.504443 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.504573 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.504674 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.504884 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.504990 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.505198 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.505299 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.505513 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.505604 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.505822 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.505915 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.506131 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.506231 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.506440 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.506540 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.506753 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.506885 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.507088 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.507215 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.507430 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.507547 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.507735 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.507817 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.508051 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.508132 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.508380 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.508482 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.508689 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.508777 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.509018 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.509101 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.509331 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.509411 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.509700 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.509796 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.509951 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.510041 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.510266 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.510359 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.510818 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.510932 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.511169 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.511266 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.511486 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.511569 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.513039 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.513171 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.513264 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.513349 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.513433 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.513516 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.513606 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.513704 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.513851 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.513948 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.514039 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.514123 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.514233 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.514484 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.514584 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.514676 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.514761 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.514854 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.514947 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.515048 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.515048 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.515228 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.515306 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.515392 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.515584 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.515667 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.515926 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.516015 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.516351 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.516540 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.516674 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.516877 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.517068 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.517222 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.517378 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.517543 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.517686 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.517829 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.517980 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.518144 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.518281 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 16:06:11.518457 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.518628 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.518773 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.518972 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.519111 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.519348 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.519453 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.519669 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.519766 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.520009 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.520112 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.520328 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.520421 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.520645 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.520745 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.520955 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.521048 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.521265 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.521366 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.521585 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.521685 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.521900 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.521991 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.522217 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.522317 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.522535 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.522626 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.522859 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.522959 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.523192 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.523359 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.523499 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.523654 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.523822 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.523968 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.524142 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.524278 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.524472 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.524566 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.524769 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.524918 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.525080 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.525224 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.525429 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.525578 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.525734 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.525883 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.526043 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.526185 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.526366 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.526502 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.526697 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.526846 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.527013 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.527235 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.527384 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.527523 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.527681 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.527822 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.527960 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.528100 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.528278 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.528421 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.528576 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.528715 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.528893 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.529028 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.529208 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.529349 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.529510 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.529666 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.529831 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.530053 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.530199 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.530344 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.530591 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.530734 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.530874 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.531022 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.531182 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.531303 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.531496 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.531602 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.531688 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.531771 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.532007 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.532116 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.532294 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.532393 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.532756 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.532964 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.533092 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.533406 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.533499 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.533735 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.533826 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.534046 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.534136 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.534365 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.534462 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.534725 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.534831 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.534994 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.535099 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.535340 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.535442 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.535661 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.535870 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.535990 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.536098 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.536292 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.536409 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.536606 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.536704 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.536917 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.537019 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.537236 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.537335 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.537554 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.537651 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.537855 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.537950 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.538167 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.538258 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.538481 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.538570 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.538791 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.538889 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.539101 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.539213 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.539431 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.539521 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.539742 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.539835 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.540066 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.540221 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.540375 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.540467 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.540693 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.540788 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.541006 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.541101 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.541333 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.541440 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.541650 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.541744 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.541962 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.542063 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.542270 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.542373 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.542577 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.542675 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.542886 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.542984 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.543218 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.543327 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.543532 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.543633 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.543846 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.543947 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.544158 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.544263 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.544465 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.544622 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.544834 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.544945 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.545091 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.545185 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.545402 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.545493 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.545733 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.545831 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.546051 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.546152 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.546367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.546543 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.546688 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.546830 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.546985 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.547175 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.547340 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.547482 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.547635 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.547784 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.547942 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.548100 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.548757 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.548972 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.549205 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.549344 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.549528 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.549664 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.549845 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.549995 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.550229 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.550367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.550509 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.550660 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.550784 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.550951 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.551091 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.551216 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.551427 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.551526 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.551746 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.551848 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.552056 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.552154 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.552372 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.552471 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.552684 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.552788 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.553008 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.553100 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.553320 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.553412 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.553634 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.553726 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.553944 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.554042 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.554262 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.554523 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.554627 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.554849 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.554949 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.555193 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.555291 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.555505 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.555611 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.555818 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.555909 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.556131 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.556230 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.556439 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.556534 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.556751 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.556843 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.557065 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.557155 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.557378 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.557555 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.557707 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.557852 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.557993 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.558148 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.558317 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.558405 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.558584 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.558730 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.558902 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.559043 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.559237 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.559383 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.559567 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.559701 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.559876 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.560025 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.560172 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.560388 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.560530 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.560670 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.560847 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.560947 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.561120 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.561259 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.561405 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.561544 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.561689 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.561915 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.562059 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.562205 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.562351 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.562499 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.562638 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.562801 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.562943 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.563091 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.563243 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.563336 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.563573 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.563671 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.563978 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.564240 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.564336 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.564421 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.564601 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.564701 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.564918 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.565168 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.565258 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.565340 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.565541 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.565641 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.565854 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.565959 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.566166 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.566255 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.566481 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.566594 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.566795 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.566896 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.567104 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.567236 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.567506 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.567677 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.567826 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.567968 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.568109 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.568270 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.568420 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.568562 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.568711 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.568853 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.569003 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.569158 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.569307 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.569456 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.569597 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.569737 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.569928 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.570128 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.570277 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.570468 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.570611 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.570789 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.570944 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.571248 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.571351 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.571445 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.571531 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.571757 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.571863 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.572091 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.572190 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.572407 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.572499 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.572722 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.572823 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.573031 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.573130 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.573342 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.573432 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.573651 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.573759 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.573961 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.574062 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.574276 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.574371 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.574585 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.574686 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.574894 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.574987 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.575230 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.575349 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.575541 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.575634 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.575846 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.575936 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.576155 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.576255 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.576462 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.576591 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.576770 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.576916 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.577087 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.577237 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.577394 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.577652 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.577822 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.577975 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.578118 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.578336 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.578478 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.578627 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.578770 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.578911 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.579069 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.579250 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.579346 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.580037 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.580134 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.580387 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.580488 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.580697 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.580797 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.581043 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.581136 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.581359 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.581450 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.581675 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.581775 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.581994 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.582082 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.582307 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.582408 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.582624 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.582713 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.582934 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.583020 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.583270 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.583389 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.583579 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.583670 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.583897 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.583998 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.584211 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.584317 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.584520 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.584648 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.584846 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.584969 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.585162 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.585274 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.585487 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.585698 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.585805 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.586020 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.586113 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.586339 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.586439 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.586672 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.586773 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.586993 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.587085 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.587336 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.587428 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.587646 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.587763 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.587955 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.588060 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.588269 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.588373 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.588581 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.588675 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.588887 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.588981 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.589202 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.589295 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.589508 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.589601 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.589829 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.589928 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.590140 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.590239 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.590448 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.590548 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.590756 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.590855 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.591071 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.591184 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.591412 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.591583 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.591721 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.591920 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.592049 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.592241 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.592366 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.592572 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.592664 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.592909 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.593010 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.593227 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.593320 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.593541 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.593634 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.593862 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.593952 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.594179 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.594272 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.594502 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.594612 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.594798 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.594901 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.595212 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.595313 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.595623 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.595741 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.595946 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.596049 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.596269 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.596362 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.596583 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.596675 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.596898 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.597003 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.597231 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.597323 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.597545 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.597644 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.597855 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.597974 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.598165 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.598259 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.598492 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.598585 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.598807 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.598909 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.599118 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.599249 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.599452 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.599546 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.599760 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.599853 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.600081 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.600180 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.600394 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.600495 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.600720 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.600833 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.601050 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.601149 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.601361 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.601458 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.601684 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.601785 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.602000 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.602100 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.602318 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.602411 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.602635 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.602735 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.602942 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.603035 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.603287 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.603407 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.603606 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.603704 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.603923 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.604022 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.604230 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.604333 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.604538 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.604637 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.604857 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.604947 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.605170 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.605269 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.605480 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.605576 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.605794 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.605914 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.606106 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.606213 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.606425 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.606517 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.606733 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.606821 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.607040 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.607204 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.607375 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.607479 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.607686 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.607785 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.608000 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.608101 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.608315 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.608417 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.608629 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.608729 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.608942 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.609040 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.609253 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.609344 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.609563 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.609654 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.609876 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.609967 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.610183 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.610284 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.610498 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.610603 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.611397 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.611511 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.611729 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.611829 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.612069 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.612171 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.612390 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.612484 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.612722 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.612813 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.613037 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.613136 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.613347 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.613440 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.613663 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.613754 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.613976 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.614078 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.614297 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.614402 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.614622 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.614721 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.614945 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.615050 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.615284 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.615378 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.615610 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.615718 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.615933 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.616037 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.616257 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.616348 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.616575 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.616793 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.616893 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.617134 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.617463 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.617554 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.617791 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.617889 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.618114 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.618206 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.618443 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.618545 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.618769 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.618866 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.619085 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.619214 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.619430 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.619538 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.619762 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.619863 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.620073 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.620164 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.620383 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.620482 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.620693 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.620786 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.621021 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.621114 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.621366 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.621486 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.621659 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.621761 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.622051 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.622151 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.622376 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.622479 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.622700 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.622793 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.623068 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.623183 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.623423 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.623517 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.623741 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.623843 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.624070 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.624170 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.624400 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.624500 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.624724 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.624814 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.625034 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.625126 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.625355 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.625456 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.625672 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.625765 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.625996 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.626093 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.626375 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.626983 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.627217 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.627341 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.627570 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.627691 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.627856 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.627957 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.628186 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.628322 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.628517 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.628627 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.628836 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.628936 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.629165 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.629257 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.629502 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.629603 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.629824 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.629924 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.630205 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.630354 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.630527 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.630682 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.630851 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.631031 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.631185 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.631391 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.631506 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.631728 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.631834 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.632051 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.632144 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.632377 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.632479 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.632712 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.632812 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.633023 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.633123 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.633335 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.633441 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.633648 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.633747 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.633963 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.634060 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.634273 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.634372 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.634581 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.634673 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.634909 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.635000 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.635242 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.635351 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.635870 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.635982 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.636147 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.636248 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.636473 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.636685 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.636844 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.637043 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.637145 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.637368 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.637474 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.637705 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.637841 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.638016 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.638161 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.638326 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.638466 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.638638 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.638742 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.638975 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.639073 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.639311 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.639412 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.639625 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.639715 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.639951 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.640043 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.640273 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.640374 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.640587 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.640678 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.640904 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.641003 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.641225 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.641318 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.641543 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.641636 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.641860 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.641996 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.642216 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.642344 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.642521 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.642623 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.642829 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.642935 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.643172 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.643269 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.643475 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.643567 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.643783 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.643886 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.644091 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.644185 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.644467 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.644671 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.644772 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.645060 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.645165 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.645295 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.645397 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.645603 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.645704 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.645933 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.646073 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.646249 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.646344 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.646581 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.646682 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.646899 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.646993 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.647234 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.647327 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.647545 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.647690 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.647857 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.647950 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.648190 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.648327 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.648499 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.648629 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.648816 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.649108 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.649216 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.649449 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.649782 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.652273 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.652400 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.652493 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.652493 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.652646 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.652772 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.652772 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.652948 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.653041 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.653133 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.653223 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.653315 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.653315 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.653474 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.653557 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.653639 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.653720 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.653811 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.653900 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.653984 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.654073 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.654163 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.654325 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.654483 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.654653 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.654777 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.654973 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.655093 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.655328 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.655468 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.655649 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.655775 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.655970 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.656091 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.656294 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.656521 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.656641 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.656861 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.656994 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.658144 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.658314 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.658459 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.658600 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.658739 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.658878 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.659023 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.659185 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.659320 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.659452 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.659581 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.659724 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.659875 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.660006 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.660135 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.660273 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.660403 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.660534 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.660674 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.660804 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.660948 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.661088 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.661226 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.661371 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.661527 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.661671 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.661891 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.662112 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.662254 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.662485 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.662485 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.662835 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.663055 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.663211 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.663362 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.663506 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.663638 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.663768 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.663906 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.664044 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.664184 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.664315 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.664452 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.664583 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.664715 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.664854 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.665022 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.665166 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.665345 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.665480 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.665666 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.665803 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.665991 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.666120 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.666317 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.666454 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.666640 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.666790 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.666958 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.667092 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.667307 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.667444 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.667649 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.667790 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.667981 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.668078 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.668313 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.668547 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.668667 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.668946 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.669072 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.669308 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.669639 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.669748 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.670025 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.670171 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.670383 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.670622 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.670834 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.671254 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.671359 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.671436 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.671506 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.671584 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.671777 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.671941 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.672093 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.672236 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.672402 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.672578 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.672741 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.673038 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.673379 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.673619 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.674421 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.674520 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.674624 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.674720 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.674806 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.674904 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.674989 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.675072 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.675199 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.675290 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.675374 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.675466 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.675559 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.675644 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.675738 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.675824 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.675907 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.676063 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.676382 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.676483 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.676728 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.676971 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.677063 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.677332 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.677432 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.677655 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.677750 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.677976 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.678068 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.678295 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.678396 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.678632 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.678729 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.678916 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.679073 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.679266 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.679356 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.679579 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.679684 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.679892 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.679987 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.680215 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.680317 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.680536 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.680629 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.680847 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.680940 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.681158 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.681259 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.681477 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.681571 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.681794 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.681888 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.682105 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.682223 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.682426 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.682531 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.682733 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.682841 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.683060 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.683204 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.683425 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.683646 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.683763 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.683965 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.684100 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.684278 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.684434 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.684644 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.684754 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.684911 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.685126 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.685220 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.685448 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.685542 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.685799 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.685893 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.686121 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.686213 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.686371 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 30 16:06:11.686462 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.686746 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.687058 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.687403 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.687716 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.688031 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.688343 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.688676 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.689516 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.689826 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.690148 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.690465 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.690794 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.691111 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.691451 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.691802 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.692122 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.692666 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.693006 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.693333 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.693896 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.694241 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.694555 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.694867 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.695202 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.695533 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.695853 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.696175 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.696492 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.696822 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.697130 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.697446 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.697766 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.698084 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.698399 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.698718 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.699067 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.699419 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.699743 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.700067 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.700390 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.700706 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.701021 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.701334 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.701668 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.701990 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.702325 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.702642 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.702951 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.703403 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.703720 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.704044 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.704373 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.705061 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.705285 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.705567 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.705907 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.706247 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.706559 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.706969 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.707224 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.707634 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.708064 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.708445 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.708773 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.709110 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.709433 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.709758 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.710075 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.710418 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.710579 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_db.sqlalchemy.engines [None req-f68547b9-9f5a-412e-8650-135384c6b7e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 16:06:11.710698 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.711016 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.711367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.711685 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.712011 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.712336 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.712662 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.712979 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.713305 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.713616 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.713940 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.714258 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.714581 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.714923 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.715269 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.715601 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.715917 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.716252 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.716568 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.716895 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.717222 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.717544 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.717859 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.718494 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.718807 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.719165 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.719476 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.719797 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.720944 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.721415 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.721758 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.722095 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.722413 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.722747 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.723073 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.723439 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.723756 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.724075 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.724414 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.724734 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.725059 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.725377 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.725696 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.726019 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.726342 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.726680 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.727021 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.727380 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.727713 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.728092 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.728414 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.728768 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.729104 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 16:06:11.729356 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 30 16:06:11.755474 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_db.sqlalchemy.engines [None req-06561196-a81b-41fa-8b97-5f5c5bee2b2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 16:06:11.880317 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.context [None req-f68547b9-9f5a-412e-8650-135384c6b7e7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ef005b1d-69a0-4b69-b2a9-e8f27f5362c8(cell1) {{(pid=107452) load_cells /opt/stack/nova/nova/context.py:464}} Jul 30 16:06:11.884615 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f68547b9-9f5a-412e-8650-135384c6b7e7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:06:11.886474 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f68547b9-9f5a-412e-8650-135384c6b7e7 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:06:11.887327 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f68547b9-9f5a-412e-8650-135384c6b7e7 None None] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:06:11.889292 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f68547b9-9f5a-412e-8650-135384c6b7e7 None None] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:06:11.901940 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_db.sqlalchemy.engines [None req-f68547b9-9f5a-412e-8650-135384c6b7e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 16:06:11.902766 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_db.sqlalchemy.engines [None req-f68547b9-9f5a-412e-8650-135384c6b7e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 16:06:11.929909 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.context [None req-06561196-a81b-41fa-8b97-5f5c5bee2b2f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ef005b1d-69a0-4b69-b2a9-e8f27f5362c8(cell1) {{(pid=107453) load_cells /opt/stack/nova/nova/context.py:464}} Jul 30 16:06:11.934185 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-06561196-a81b-41fa-8b97-5f5c5bee2b2f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:06:11.935889 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-06561196-a81b-41fa-8b97-5f5c5bee2b2f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:06:11.936648 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-06561196-a81b-41fa-8b97-5f5c5bee2b2f None None] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:06:11.938616 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-06561196-a81b-41fa-8b97-5f5c5bee2b2f None None] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:06:11.949435 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_db.sqlalchemy.engines [None req-06561196-a81b-41fa-8b97-5f5c5bee2b2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 16:06:11.954762 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_db.sqlalchemy.engines [None req-06561196-a81b-41fa-8b97-5f5c5bee2b2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 16:06:12.171029 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_db.sqlalchemy.engines [None req-f68547b9-9f5a-412e-8650-135384c6b7e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 16:06:12.219407 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_db.sqlalchemy.engines [None req-06561196-a81b-41fa-8b97-5f5c5bee2b2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 16:06:12.501138 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: WARNING keystonemiddleware.auth_token [None req-f68547b9-9f5a-412e-8650-135384c6b7e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 16:06:12.508830 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: WARNING keystonemiddleware.auth_token [None req-f68547b9-9f5a-412e-8650-135384c6b7e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 16:06:12.553879 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: WARNING keystonemiddleware.auth_token [None req-06561196-a81b-41fa-8b97-5f5c5bee2b2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 16:06:12.560697 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: WARNING keystonemiddleware.auth_token [None req-06561196-a81b-41fa-8b97-5f5c5bee2b2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 16:06:12.860039 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: WARNING keystonemiddleware.auth_token [None req-f68547b9-9f5a-412e-8650-135384c6b7e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 16:06:12.865737 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: WARNING keystonemiddleware.auth_token [None req-f68547b9-9f5a-412e-8650-135384c6b7e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 16:06:12.870856 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5628379d79c0 pid: 107452 (default app) Jul 30 16:06:12.909745 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: WARNING keystonemiddleware.auth_token [None req-06561196-a81b-41fa-8b97-5f5c5bee2b2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 16:06:12.914896 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: WARNING keystonemiddleware.auth_token [None req-06561196-a81b-41fa-8b97-5f5c5bee2b2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 16:06:12.920256 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5628379d79c0 pid: 107453 (default app) Jul 30 16:06:46.691187 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f4d96b7c-39d7-4d64-b1b4-cbd6260306b1 tempest-VolumesGetTestJSON-135004320 tempest-VolumesGetTestJSON-135004320-project] Action: 'create', calling method: .version_select at 0x7fb1809fa160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1887121687", "metadata": {"Type": "work"}}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:06:47.507415 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f67b9953-9c1b-48c6-a90c-113c24dd1371 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-548357102", "imageRef": "eea29a7d-10c3-489a-adee-10be2e7a26bd", "flavorRef": "452", "networks": [{"uuid": "6191907a-fbea-44ab-ae22-c0c0bbc16432"}]}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:06:48.616677 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.network.neutron [None req-f67b9953-9c1b-48c6-a90c-113c24dd1371 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] validate_networks() for [('6191907a-fbea-44ab-ae22-c0c0bbc16432', None, None, None)] {{(pid=107453) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:06:49.168873 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f4d96b7c-39d7-4d64-b1b4-cbd6260306b1 tempest-VolumesGetTestJSON-135004320 tempest-VolumesGetTestJSON-135004320-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.971087 Jul 30 16:06:49.179090 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 1/1] 10.222.0.37 () {60 vars in 1156 bytes} [Fri Jul 30 16:06:45 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 3983 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 30 16:06:49.186001 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1e70b3fe-3ac7-41dd-9075-9d090a0e03c5 tempest-VolumesGetTestJSON-135004320 tempest-VolumesGetTestJSON-135004320-project] Calling method '.version_select at 0x7fb180842c10>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:06:49.559178 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1e70b3fe-3ac7-41dd-9075-9d090a0e03c5 tempest-VolumesGetTestJSON-135004320 tempest-VolumesGetTestJSON-135004320-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/feca88f8-8549-4622-8aa2-10fdd468e5b5" status: 200 len: 353 microversion: 2.1 time: 0.378333 Jul 30 16:06:49.561627 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 2/2] 10.222.0.37 () {58 vars in 1245 bytes} [Fri Jul 30 16:06:49 2021] GET /compute/v2.1/os-volumes/feca88f8-8549-4622-8aa2-10fdd468e5b5 => generated 353 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:06:50.572058 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-4b3157b9-99c8-43a3-b384-839403eb5deb tempest-VolumesGetTestJSON-135004320 tempest-VolumesGetTestJSON-135004320-project] Calling method '.version_select at 0x7fb1808564c0>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:06:50.657480 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-4b3157b9-99c8-43a3-b384-839403eb5deb tempest-VolumesGetTestJSON-135004320 tempest-VolumesGetTestJSON-135004320-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/feca88f8-8549-4622-8aa2-10fdd468e5b5" status: 200 len: 354 microversion: 2.1 time: 0.089220 Jul 30 16:06:50.658345 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 3/3] 10.222.0.37 () {58 vars in 1245 bytes} [Fri Jul 30 16:06:50 2021] GET /compute/v2.1/os-volumes/feca88f8-8549-4622-8aa2-10fdd468e5b5 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:06:50.669745 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d97d3eb7-a275-4b5c-b102-b10b8fe0a36a tempest-VolumesGetTestJSON-135004320 tempest-VolumesGetTestJSON-135004320-project] Calling method '.version_select at 0x7fb180842ca0>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:06:50.926207 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d97d3eb7-a275-4b5c-b102-b10b8fe0a36a tempest-VolumesGetTestJSON-135004320 tempest-VolumesGetTestJSON-135004320-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/feca88f8-8549-4622-8aa2-10fdd468e5b5" status: 200 len: 354 microversion: 2.1 time: 0.260759 Jul 30 16:06:50.937603 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 4/4] 10.222.0.37 () {58 vars in 1245 bytes} [Fri Jul 30 16:06:50 2021] GET /compute/v2.1/os-volumes/feca88f8-8549-4622-8aa2-10fdd468e5b5 => generated 354 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:06:50.944522 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-643d1cb4-07ab-40b8-8d28-c6a404f81999 tempest-VolumesGetTestJSON-135004320 tempest-VolumesGetTestJSON-135004320-project] Calling method '.version_select at 0x7fb1808560d0>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:06:51.297461 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-f67b9953-9c1b-48c6-a90c-113c24dd1371 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Flavor limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:06:51.298680 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-f67b9953-9c1b-48c6-a90c-113c24dd1371 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Image limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:06:51.299329 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-f67b9953-9c1b-48c6-a90c-113c24dd1371 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Flavor pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:06:51.300050 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-f67b9953-9c1b-48c6-a90c-113c24dd1371 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Image pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:06:51.300683 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-f67b9953-9c1b-48c6-a90c-113c24dd1371 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:06:51.329577 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f67b9953-9c1b-48c6-a90c-113c24dd1371 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:06:51.330340 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f67b9953-9c1b-48c6-a90c-113c24dd1371 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:06:51.331429 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f67b9953-9c1b-48c6-a90c-113c24dd1371 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:06:51.333399 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f67b9953-9c1b-48c6-a90c-113c24dd1371 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:06:51.418608 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-f67b9953-9c1b-48c6-a90c-113c24dd1371 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Getting quotas for project 8aea870288784c9c87d2bdaf98594503. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:06:51.440606 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-f67b9953-9c1b-48c6-a90c-113c24dd1371 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Getting quotas for user 8d02759bebc64429b082b22246bb2f42 and project 8aea870288784c9c87d2bdaf98594503. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:06:51.474550 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f67b9953-9c1b-48c6-a90c-113c24dd1371 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Going to run 1 instances... {{(pid=107453) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:06:51.488538 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f67b9953-9c1b-48c6-a90c-113c24dd1371 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eea29a7d-10c3-489a-adee-10be2e7a26bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:06:51.702824 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f67b9953-9c1b-48c6-a90c-113c24dd1371 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.494341 Jul 30 16:06:51.704256 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 1/5] 10.222.0.37 () {60 vars in 1147 bytes} [Fri Jul 30 16:06:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 5497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 16:06:51.715306 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-622dd5ad-411c-48f6-bddf-27a2680b1378 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:06:51.716512 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-622dd5ad-411c-48f6-bddf-27a2680b1378 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:06:51.804815 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-643d1cb4-07ab-40b8-8d28-c6a404f81999 tempest-VolumesGetTestJSON-135004320 tempest-VolumesGetTestJSON-135004320-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/feca88f8-8549-4622-8aa2-10fdd468e5b5" status: 202 len: 0 microversion: 2.1 time: 0.864119 Jul 30 16:06:51.806191 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 5/6] 10.222.0.37 () {58 vars in 1248 bytes} [Fri Jul 30 16:06:50 2021] DELETE /compute/v2.1/os-volumes/feca88f8-8549-4622-8aa2-10fdd468e5b5 => generated 0 bytes in 867 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:06:51.814694 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1eb27a6e-5a04-40a3-9b0f-9cba2ef59349 tempest-VolumesGetTestJSON-135004320 tempest-VolumesGetTestJSON-135004320-project] Calling method '.version_select at 0x7fb18085c160>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:06:51.984504 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-622dd5ad-411c-48f6-bddf-27a2680b1378 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:06:52.015896 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-622dd5ad-411c-48f6-bddf-27a2680b1378 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1214 microversion: 2.1 time: 0.305092 Jul 30 16:06:52.017095 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 2/7] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:06:51 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1214 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:06:52.040294 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1eb27a6e-5a04-40a3-9b0f-9cba2ef59349 tempest-VolumesGetTestJSON-135004320 tempest-VolumesGetTestJSON-135004320-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/feca88f8-8549-4622-8aa2-10fdd468e5b5" status: 200 len: 353 microversion: 2.1 time: 0.229902 Jul 30 16:06:52.048625 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 6/8] 10.222.0.37 () {58 vars in 1245 bytes} [Fri Jul 30 16:06:51 2021] GET /compute/v2.1/os-volumes/feca88f8-8549-4622-8aa2-10fdd468e5b5 => generated 353 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:06:53.034998 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-11c5e0ab-de58-42c7-9285-04723924e86c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:06:53.036409 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-11c5e0ab-de58-42c7-9285-04723924e86c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:06:53.061203 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1ad6951b-a304-4d1d-a6d0-3b3c99111aea tempest-VolumesGetTestJSON-135004320 tempest-VolumesGetTestJSON-135004320-project] Calling method '.version_select at 0x7fb180856ee0>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:06:53.139163 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-1ad6951b-a304-4d1d-a6d0-3b3c99111aea tempest-VolumesGetTestJSON-135004320 tempest-VolumesGetTestJSON-135004320-project] HTTP exception thrown: Volume feca88f8-8549-4622-8aa2-10fdd468e5b5 could not be found. Jul 30 16:06:53.139847 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1ad6951b-a304-4d1d-a6d0-3b3c99111aea tempest-VolumesGetTestJSON-135004320 tempest-VolumesGetTestJSON-135004320-project] Returning 404 to user: Volume feca88f8-8549-4622-8aa2-10fdd468e5b5 could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:06:53.140760 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1ad6951b-a304-4d1d-a6d0-3b3c99111aea tempest-VolumesGetTestJSON-135004320 tempest-VolumesGetTestJSON-135004320-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/feca88f8-8549-4622-8aa2-10fdd468e5b5" status: 404 len: 109 microversion: 2.1 time: 0.088850 Jul 30 16:06:53.141893 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 7/9] 10.222.0.37 () {58 vars in 1245 bytes} [Fri Jul 30 16:06:53 2021] GET /compute/v2.1/os-volumes/feca88f8-8549-4622-8aa2-10fdd468e5b5 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:06:53.383228 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-11c5e0ab-de58-42c7-9285-04723924e86c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:06:53.390738 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-11c5e0ab-de58-42c7-9285-04723924e86c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1214 microversion: 2.1 time: 0.359831 Jul 30 16:06:53.393974 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 3/10] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:06:53 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1214 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:06:54.412930 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3107172a-a5c1-4baa-90fb-57c5d134b043 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:06:54.413698 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3107172a-a5c1-4baa-90fb-57c5d134b043 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:06:54.441821 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3107172a-a5c1-4baa-90fb-57c5d134b043 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:06:54.442285 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3107172a-a5c1-4baa-90fb-57c5d134b043 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:06:54.443367 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3107172a-a5c1-4baa-90fb-57c5d134b043 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:06:54.445917 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3107172a-a5c1-4baa-90fb-57c5d134b043 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:06:54.723086 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-3107172a-a5c1-4baa-90fb-57c5d134b043 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:06:54.789961 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3107172a-a5c1-4baa-90fb-57c5d134b043 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1218 microversion: 2.1 time: 0.380328 Jul 30 16:06:54.790603 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 8/11] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:06:54 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1218 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:06:55.806939 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c640d889-7f28-474a-b720-cb93c4241bfa tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:06:55.808179 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c640d889-7f28-474a-b720-cb93c4241bfa tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:06:55.822221 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c640d889-7f28-474a-b720-cb93c4241bfa tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:06:55.822692 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c640d889-7f28-474a-b720-cb93c4241bfa tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:06:55.823518 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c640d889-7f28-474a-b720-cb93c4241bfa tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:06:55.824018 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c640d889-7f28-474a-b720-cb93c4241bfa tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:06:56.133241 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c640d889-7f28-474a-b720-cb93c4241bfa tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:06:56.154245 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c640d889-7f28-474a-b720-cb93c4241bfa tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1218 microversion: 2.1 time: 0.350653 Jul 30 16:06:56.156367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 4/12] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:06:55 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1218 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:06:57.182479 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f3cbb850-2ed2-408c-b8fd-eb84fd0dd5d7 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:06:57.182962 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f3cbb850-2ed2-408c-b8fd-eb84fd0dd5d7 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:06:57.190279 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f3cbb850-2ed2-408c-b8fd-eb84fd0dd5d7 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:06:57.190729 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f3cbb850-2ed2-408c-b8fd-eb84fd0dd5d7 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:06:57.196472 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f3cbb850-2ed2-408c-b8fd-eb84fd0dd5d7 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:06:57.196943 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f3cbb850-2ed2-408c-b8fd-eb84fd0dd5d7 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:06:57.470530 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f3cbb850-2ed2-408c-b8fd-eb84fd0dd5d7 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:06:57.490677 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f3cbb850-2ed2-408c-b8fd-eb84fd0dd5d7 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1218 microversion: 2.1 time: 0.311743 Jul 30 16:06:57.491307 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 9/13] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:06:57 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1218 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:06:58.067758 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0d79544f-7eb5-4a28-991d-48e90c28da08 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'create', calling method: .version_select at 0x7fb17ff13e50>, body: {"keypair": {"name": "tempest-keypair-547123597"}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:06:58.151048 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-0d79544f-7eb5-4a28-991d-48e90c28da08 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Getting quotas for project 71bd283ed91a45de8865533d41ffec34. Resources: {'key_pairs'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:06:58.159406 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-0d79544f-7eb5-4a28-991d-48e90c28da08 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Getting quotas for user ab02c2f0aba54c22b96721d792ae4a69 and project 71bd283ed91a45de8865533d41ffec34. Resources: {'key_pairs'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:06:58.288729 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e1c265ec-6089-4d83-ad3b-d2600e964fa8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'create', calling method: .version_select at 0x7fb1807b19d0>, body: {"keypair": {"name": "tempest-keypair-533505272"}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:06:58.425031 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-e1c265ec-6089-4d83-ad3b-d2600e964fa8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Getting quotas for project 18470f178d164e4a822da596125f2a31. Resources: {'key_pairs'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:06:58.435750 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-e1c265ec-6089-4d83-ad3b-d2600e964fa8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Getting quotas for user 6aaf97d73fdd480bb6b5affcd2bdcfe4 and project 18470f178d164e4a822da596125f2a31. Resources: {'key_pairs'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:06:58.500319 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-0d79544f-7eb5-4a28-991d-48e90c28da08 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Getting quotas for project 71bd283ed91a45de8865533d41ffec34. Resources: {'key_pairs'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:06:58.512980 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-0d79544f-7eb5-4a28-991d-48e90c28da08 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Getting quotas for user ab02c2f0aba54c22b96721d792ae4a69 and project 71bd283ed91a45de8865533d41ffec34. Resources: {'key_pairs'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:06:58.544821 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0d79544f-7eb5-4a28-991d-48e90c28da08 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.888575 Jul 30 16:06:58.551149 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 5/14] 10.222.0.37 () {60 vars in 1158 bytes} [Fri Jul 30 16:06:57 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:06:58.556763 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9ceb5df5-ed59-4fd4-b617-bb82acc0441a tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:06:58.566110 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9ceb5df5-ed59-4fd4-b617-bb82acc0441a tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:06:58.580088 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9ceb5df5-ed59-4fd4-b617-bb82acc0441a tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:06:58.582178 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9ceb5df5-ed59-4fd4-b617-bb82acc0441a tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:06:58.584509 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9ceb5df5-ed59-4fd4-b617-bb82acc0441a tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:06:58.585967 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9ceb5df5-ed59-4fd4-b617-bb82acc0441a tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:06:58.725543 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9ceb5df5-ed59-4fd4-b617-bb82acc0441a tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:06:58.740764 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9ceb5df5-ed59-4fd4-b617-bb82acc0441a tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1218 microversion: 2.1 time: 0.188162 Jul 30 16:06:58.742875 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 6/15] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:06:58 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1218 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:06:59.155714 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-e1c265ec-6089-4d83-ad3b-d2600e964fa8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Getting quotas for project 18470f178d164e4a822da596125f2a31. Resources: {'key_pairs'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:06:59.172093 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-e1c265ec-6089-4d83-ad3b-d2600e964fa8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Getting quotas for user 6aaf97d73fdd480bb6b5affcd2bdcfe4 and project 18470f178d164e4a822da596125f2a31. Resources: {'key_pairs'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:06:59.213981 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e1c265ec-6089-4d83-ad3b-d2600e964fa8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.302824 Jul 30 16:06:59.240617 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 10/16] 10.222.0.37 () {62 vars in 1199 bytes} [Fri Jul 30 16:06:57 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1330 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jul 30 16:06:59.759118 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-5ff93efd-8394-41d7-b9fd-82a78c83c5e5 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:06:59.759853 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-5ff93efd-8394-41d7-b9fd-82a78c83c5e5 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:06:59.760944 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1dde1c58-8bc4-4e7b-8b2c-81c660167aba tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-791170177", "imageRef": "eea29a7d-10c3-489a-adee-10be2e7a26bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ae50bb3-8e84-4c6c-a9c3-090b63e0f099"}]}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:06:59.769490 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5ff93efd-8394-41d7-b9fd-82a78c83c5e5 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:06:59.770463 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5ff93efd-8394-41d7-b9fd-82a78c83c5e5 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:06:59.772267 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5ff93efd-8394-41d7-b9fd-82a78c83c5e5 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:06:59.772889 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5ff93efd-8394-41d7-b9fd-82a78c83c5e5 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:06:59.922883 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.network.neutron [None req-1dde1c58-8bc4-4e7b-8b2c-81c660167aba tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] validate_networks() for [('7ae50bb3-8e84-4c6c-a9c3-090b63e0f099', None, None, None)] {{(pid=107453) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:06:59.962057 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-5ff93efd-8394-41d7-b9fd-82a78c83c5e5 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:06:59.977065 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-5ff93efd-8394-41d7-b9fd-82a78c83c5e5 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1266 microversion: 2.1 time: 0.220087 Jul 30 16:06:59.977626 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 11/17] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:06:59 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:01.013599 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b33bc116-abdd-471a-8abf-9e50b9c00ead tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:01.013599 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b33bc116-abdd-471a-8abf-9e50b9c00ead tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:01.017825 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b33bc116-abdd-471a-8abf-9e50b9c00ead tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:01.018296 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b33bc116-abdd-471a-8abf-9e50b9c00ead tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:01.019125 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b33bc116-abdd-471a-8abf-9e50b9c00ead tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:01.019796 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b33bc116-abdd-471a-8abf-9e50b9c00ead tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:01.212768 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b33bc116-abdd-471a-8abf-9e50b9c00ead tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:01.227164 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b33bc116-abdd-471a-8abf-9e50b9c00ead tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1272 microversion: 2.1 time: 0.236196 Jul 30 16:07:01.237273 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 12/18] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:00 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:02.255684 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ab023c23-1aac-431e-93c5-9c903d004b0a tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:02.256418 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ab023c23-1aac-431e-93c5-9c903d004b0a tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:02.274201 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ab023c23-1aac-431e-93c5-9c903d004b0a tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:02.279598 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ab023c23-1aac-431e-93c5-9c903d004b0a tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:02.285835 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ab023c23-1aac-431e-93c5-9c903d004b0a tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:02.286520 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ab023c23-1aac-431e-93c5-9c903d004b0a tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:02.464810 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-ab023c23-1aac-431e-93c5-9c903d004b0a tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:02.473316 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ab023c23-1aac-431e-93c5-9c903d004b0a tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1272 microversion: 2.1 time: 0.221643 Jul 30 16:07:02.479351 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 13/19] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:02 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1272 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:03.438936 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-1dde1c58-8bc4-4e7b-8b2c-81c660167aba tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Flavor limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:07:03.439880 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-1dde1c58-8bc4-4e7b-8b2c-81c660167aba tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Image limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:07:03.439880 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-1dde1c58-8bc4-4e7b-8b2c-81c660167aba tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Flavor pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:07:03.440294 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-1dde1c58-8bc4-4e7b-8b2c-81c660167aba tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Image pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:07:03.440955 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-1dde1c58-8bc4-4e7b-8b2c-81c660167aba tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:07:03.472429 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1dde1c58-8bc4-4e7b-8b2c-81c660167aba tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:03.472870 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1dde1c58-8bc4-4e7b-8b2c-81c660167aba tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:03.473771 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1dde1c58-8bc4-4e7b-8b2c-81c660167aba tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:03.474238 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1dde1c58-8bc4-4e7b-8b2c-81c660167aba tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:03.491446 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-4c43ba37-3de5-41fe-9eef-f39e958ad1a5 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:03.492139 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-4c43ba37-3de5-41fe-9eef-f39e958ad1a5 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:03.502489 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4c43ba37-3de5-41fe-9eef-f39e958ad1a5 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:03.502714 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4c43ba37-3de5-41fe-9eef-f39e958ad1a5 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:03.506366 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4c43ba37-3de5-41fe-9eef-f39e958ad1a5 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:03.508507 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4c43ba37-3de5-41fe-9eef-f39e958ad1a5 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:03.577164 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-1dde1c58-8bc4-4e7b-8b2c-81c660167aba tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Getting quotas for project e827ef52c141425d86e34941944a68cc. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:07:03.595871 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-1dde1c58-8bc4-4e7b-8b2c-81c660167aba tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Getting quotas for user 36b6bef9b03c4c74b3a0760a0fa219fa and project e827ef52c141425d86e34941944a68cc. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:07:03.633859 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1dde1c58-8bc4-4e7b-8b2c-81c660167aba tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Going to run 1 instances... {{(pid=107453) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:07:03.647965 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1dde1c58-8bc4-4e7b-8b2c-81c660167aba tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eea29a7d-10c3-489a-adee-10be2e7a26bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:07:03.782989 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1dde1c58-8bc4-4e7b-8b2c-81c660167aba tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.314776 Jul 30 16:07:03.806383 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 7/20] 10.222.0.37 () {60 vars in 1147 bytes} [Fri Jul 30 16:06:59 2021] POST /compute/v2.1/servers => generated 383 bytes in 4339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 16:07:03.814476 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-afec652a-bd40-4904-a3cc-f380a4e4eeec tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-645879915", "imageRef": "eea29a7d-10c3-489a-adee-10be2e7a26bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7bf86150-dae2-4a45-a359-67121f10c5f9"}], "security_groups": [{"name": "tempest-securitygroup--752715356"}], "key_name": "tempest-keypair-547123597", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:03.905350 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-4c43ba37-3de5-41fe-9eef-f39e958ad1a5 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:03.920212 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-4c43ba37-3de5-41fe-9eef-f39e958ad1a5 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.432850 Jul 30 16:07:03.923117 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 14/21] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:03 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:03.946390 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-cdda4eb3-6b3a-4f2b-ae65-d401f0a319dd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:03.948715 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-cdda4eb3-6b3a-4f2b-ae65-d401f0a319dd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:04.146985 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.network.neutron [None req-afec652a-bd40-4904-a3cc-f380a4e4eeec tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] validate_networks() for [('7bf86150-dae2-4a45-a359-67121f10c5f9', None, None, None)] {{(pid=107453) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:07:04.201661 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-cdda4eb3-6b3a-4f2b-ae65-d401f0a319dd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:04.231669 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-cdda4eb3-6b3a-4f2b-ae65-d401f0a319dd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1221 microversion: 2.1 time: 0.306595 Jul 30 16:07:04.270298 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 15/22] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:03 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1221 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:04.567908 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-55de1cdf-833b-4cc1-9735-c38f4aaee1cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-419597806", "imageRef": "eea29a7d-10c3-489a-adee-10be2e7a26bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ae50bb3-8e84-4c6c-a9c3-090b63e0f099"}]}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:04.725477 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.network.neutron [None req-55de1cdf-833b-4cc1-9735-c38f4aaee1cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] validate_networks() for [('7ae50bb3-8e84-4c6c-a9c3-090b63e0f099', None, None, None)] {{(pid=107452) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:07:05.006691 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-afec652a-bd40-4904-a3cc-f380a4e4eeec tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Flavor limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:07:05.008148 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-afec652a-bd40-4904-a3cc-f380a4e4eeec tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Image limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:07:05.008692 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-afec652a-bd40-4904-a3cc-f380a4e4eeec tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Flavor pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:07:05.009113 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-afec652a-bd40-4904-a3cc-f380a4e4eeec tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Image pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:07:05.009540 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-afec652a-bd40-4904-a3cc-f380a4e4eeec tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:07:05.023423 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-afec652a-bd40-4904-a3cc-f380a4e4eeec tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:05.023882 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-afec652a-bd40-4904-a3cc-f380a4e4eeec tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:05.024697 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-afec652a-bd40-4904-a3cc-f380a4e4eeec tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:05.025207 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-afec652a-bd40-4904-a3cc-f380a4e4eeec tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:05.077305 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-afec652a-bd40-4904-a3cc-f380a4e4eeec tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Getting quotas for project 71bd283ed91a45de8865533d41ffec34. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:07:05.089054 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-afec652a-bd40-4904-a3cc-f380a4e4eeec tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Getting quotas for user ab02c2f0aba54c22b96721d792ae4a69 and project 71bd283ed91a45de8865533d41ffec34. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:07:05.112973 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-afec652a-bd40-4904-a3cc-f380a4e4eeec tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Going to run 1 instances... {{(pid=107453) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:07:05.129439 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-afec652a-bd40-4904-a3cc-f380a4e4eeec tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eea29a7d-10c3-489a-adee-10be2e7a26bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:07:05.235919 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-afec652a-bd40-4904-a3cc-f380a4e4eeec tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.425681 Jul 30 16:07:05.242289 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 8/23] 10.222.0.37 () {60 vars in 1147 bytes} [Fri Jul 30 16:07:03 2021] POST /compute/v2.1/servers => generated 401 bytes in 1435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 16:07:05.248198 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c9a5bebe-df24-4b9b-a84b-a30671a2c308 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:05.249661 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c9a5bebe-df24-4b9b-a84b-a30671a2c308 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:05.273884 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c9a5bebe-df24-4b9b-a84b-a30671a2c308 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:05.273988 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c9a5bebe-df24-4b9b-a84b-a30671a2c308 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:05.275439 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c9a5bebe-df24-4b9b-a84b-a30671a2c308 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:05.276107 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c9a5bebe-df24-4b9b-a84b-a30671a2c308 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:05.551397 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c9a5bebe-df24-4b9b-a84b-a30671a2c308 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:05.561779 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c9a5bebe-df24-4b9b-a84b-a30671a2c308 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.318094 Jul 30 16:07:05.562585 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 9/24] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:05 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:05.574653 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-62b13dbc-fc9d-4c12-87b5-77bab0ba9a28 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:05.575501 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-62b13dbc-fc9d-4c12-87b5-77bab0ba9a28 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:05.692424 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-62b13dbc-fc9d-4c12-87b5-77bab0ba9a28 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:05.705158 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-62b13dbc-fc9d-4c12-87b5-77bab0ba9a28 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1236 microversion: 2.1 time: 0.140936 Jul 30 16:07:05.707398 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 10/25] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:05 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1236 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:06.362047 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0c6040de-4313-4688-afc2-7579d5f2da58 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2040589971", "imageRef": "eea29a7d-10c3-489a-adee-10be2e7a26bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d7fe3aa-ac98-4f16-a434-6dcaa4687c10"}], "security_groups": [{"name": "tempest-securitygroup--1226789288"}], "key_name": "tempest-keypair-533505272", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:06.533900 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.network.neutron [None req-0c6040de-4313-4688-afc2-7579d5f2da58 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] validate_networks() for [('4d7fe3aa-ac98-4f16-a434-6dcaa4687c10', None, None, None)] {{(pid=107453) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:07:06.714825 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-55de1cdf-833b-4cc1-9735-c38f4aaee1cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Flavor limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:07:06.715356 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-55de1cdf-833b-4cc1-9735-c38f4aaee1cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Image limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:07:06.715773 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-55de1cdf-833b-4cc1-9735-c38f4aaee1cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Flavor pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:07:06.716190 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-55de1cdf-833b-4cc1-9735-c38f4aaee1cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Image pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:07:06.716920 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-55de1cdf-833b-4cc1-9735-c38f4aaee1cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:07:06.728466 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-55de1cdf-833b-4cc1-9735-c38f4aaee1cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:06.728923 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-55de1cdf-833b-4cc1-9735-c38f4aaee1cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:06.729912 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-55de1cdf-833b-4cc1-9735-c38f4aaee1cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:06.730524 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-55de1cdf-833b-4cc1-9735-c38f4aaee1cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:06.764224 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-55de1cdf-833b-4cc1-9735-c38f4aaee1cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Getting quotas for project e827ef52c141425d86e34941944a68cc. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:07:06.774355 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-55de1cdf-833b-4cc1-9735-c38f4aaee1cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Getting quotas for user 36b6bef9b03c4c74b3a0760a0fa219fa and project e827ef52c141425d86e34941944a68cc. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:07:06.787683 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-55de1cdf-833b-4cc1-9735-c38f4aaee1cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Going to run 1 instances... {{(pid=107452) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:07:06.796484 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-55de1cdf-833b-4cc1-9735-c38f4aaee1cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eea29a7d-10c3-489a-adee-10be2e7a26bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:07:06.914553 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-55de1cdf-833b-4cc1-9735-c38f4aaee1cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.350923 Jul 30 16:07:06.918530 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 16/26] 10.222.0.37 () {60 vars in 1147 bytes} [Fri Jul 30 16:07:04 2021] POST /compute/v2.1/servers => generated 383 bytes in 2356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 16:07:06.972284 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-564d3e96-b3ab-4cdd-a608-9ff3fff822e4 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:06.989017 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-564d3e96-b3ab-4cdd-a608-9ff3fff822e4 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:07.016469 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-564d3e96-b3ab-4cdd-a608-9ff3fff822e4 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:07.023474 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-564d3e96-b3ab-4cdd-a608-9ff3fff822e4 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:07.024408 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-564d3e96-b3ab-4cdd-a608-9ff3fff822e4 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:07.024865 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-564d3e96-b3ab-4cdd-a608-9ff3fff822e4 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:07.336144 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-564d3e96-b3ab-4cdd-a608-9ff3fff822e4 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:07.358517 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-564d3e96-b3ab-4cdd-a608-9ff3fff822e4 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.438222 Jul 30 16:07:07.360179 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 17/27] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:06 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:07.377387 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8421b59e-f3fb-4984-95cd-f22c69593a79 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:07.378709 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8421b59e-f3fb-4984-95cd-f22c69593a79 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:07.387234 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8421b59e-f3fb-4984-95cd-f22c69593a79 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:07.388554 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8421b59e-f3fb-4984-95cd-f22c69593a79 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:07.390918 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8421b59e-f3fb-4984-95cd-f22c69593a79 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:07.392603 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8421b59e-f3fb-4984-95cd-f22c69593a79 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:07.598319 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8421b59e-f3fb-4984-95cd-f22c69593a79 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:07.609114 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8421b59e-f3fb-4984-95cd-f22c69593a79 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1240 microversion: 2.1 time: 0.245177 Jul 30 16:07:07.612347 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 18/28] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:07 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1240 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:07.624917 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-7d6b6303-13a3-4bb3-9e95-83c67af0d902 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:07.625667 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7d6b6303-13a3-4bb3-9e95-83c67af0d902 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:07.746226 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-7d6b6303-13a3-4bb3-9e95-83c67af0d902 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:07.765094 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-7d6b6303-13a3-4bb3-9e95-83c67af0d902 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1221 microversion: 2.1 time: 0.146521 Jul 30 16:07:07.766811 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 19/29] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:07 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1221 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:07.814721 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-0c6040de-4313-4688-afc2-7579d5f2da58 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Flavor limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:07:07.815221 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-0c6040de-4313-4688-afc2-7579d5f2da58 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Image limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:07:07.815845 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-0c6040de-4313-4688-afc2-7579d5f2da58 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Flavor pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:07:07.816550 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-0c6040de-4313-4688-afc2-7579d5f2da58 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Image pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:07:07.817310 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-0c6040de-4313-4688-afc2-7579d5f2da58 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:07:07.853076 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0c6040de-4313-4688-afc2-7579d5f2da58 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:07.853605 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0c6040de-4313-4688-afc2-7579d5f2da58 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:07.867089 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0c6040de-4313-4688-afc2-7579d5f2da58 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:07.867959 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0c6040de-4313-4688-afc2-7579d5f2da58 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:07.926851 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-0c6040de-4313-4688-afc2-7579d5f2da58 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Getting quotas for project 18470f178d164e4a822da596125f2a31. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:07:07.931945 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-0c6040de-4313-4688-afc2-7579d5f2da58 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Getting quotas for user 6aaf97d73fdd480bb6b5affcd2bdcfe4 and project 18470f178d164e4a822da596125f2a31. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:07:07.946454 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0c6040de-4313-4688-afc2-7579d5f2da58 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Going to run 1 instances... {{(pid=107453) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:07:07.953119 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0c6040de-4313-4688-afc2-7579d5f2da58 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eea29a7d-10c3-489a-adee-10be2e7a26bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:07:08.049853 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0c6040de-4313-4688-afc2-7579d5f2da58 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.692617 Jul 30 16:07:08.056092 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 11/30] 10.222.0.37 () {62 vars in 1188 bytes} [Fri Jul 30 16:07:06 2021] POST /compute/v2.1/servers => generated 402 bytes in 1699 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 30 16:07:08.061612 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d5eb2240-3623-4744-b117-fe45c108ad72 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:08.062425 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d5eb2240-3623-4744-b117-fe45c108ad72 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:08.169143 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d5eb2240-3623-4744-b117-fe45c108ad72 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:08.186170 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d5eb2240-3623-4744-b117-fe45c108ad72 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:08.188188 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d5eb2240-3623-4744-b117-fe45c108ad72 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:08.189584 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d5eb2240-3623-4744-b117-fe45c108ad72 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1281 microversion: 2.20 time: 0.132404 Jul 30 16:07:08.201778 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 20/31] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:08 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1281 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:08.383071 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-341ebfa0-0845-437a-a5f2-ab7b0da6fbcc tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:08.383945 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-341ebfa0-0845-437a-a5f2-ab7b0da6fbcc tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:08.397262 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-341ebfa0-0845-437a-a5f2-ab7b0da6fbcc tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:08.397749 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-341ebfa0-0845-437a-a5f2-ab7b0da6fbcc tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:08.398573 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-341ebfa0-0845-437a-a5f2-ab7b0da6fbcc tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:08.399017 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-341ebfa0-0845-437a-a5f2-ab7b0da6fbcc tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:08.628922 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-549e7198-1aa5-49ef-b686-c0a78e0b4028 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:08.629542 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-549e7198-1aa5-49ef-b686-c0a78e0b4028 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:08.637495 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-549e7198-1aa5-49ef-b686-c0a78e0b4028 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:08.637957 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-549e7198-1aa5-49ef-b686-c0a78e0b4028 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:08.638749 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-549e7198-1aa5-49ef-b686-c0a78e0b4028 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:08.639213 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-549e7198-1aa5-49ef-b686-c0a78e0b4028 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:08.752949 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-341ebfa0-0845-437a-a5f2-ab7b0da6fbcc tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:08.763765 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-341ebfa0-0845-437a-a5f2-ab7b0da6fbcc tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.391569 Jul 30 16:07:08.767321 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 12/32] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:08 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:08.785305 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-229ffcac-c7e3-42c7-8328-9fc309808414 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:08.786370 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-229ffcac-c7e3-42c7-8328-9fc309808414 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:08.805893 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-229ffcac-c7e3-42c7-8328-9fc309808414 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:08.813842 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-229ffcac-c7e3-42c7-8328-9fc309808414 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:08.818212 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-229ffcac-c7e3-42c7-8328-9fc309808414 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:08.819953 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-229ffcac-c7e3-42c7-8328-9fc309808414 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:08.829911 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-549e7198-1aa5-49ef-b686-c0a78e0b4028 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:08.855298 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-549e7198-1aa5-49ef-b686-c0a78e0b4028 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1240 microversion: 2.1 time: 0.227001 Jul 30 16:07:08.859463 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 21/33] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:08 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1240 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:09.001659 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-229ffcac-c7e3-42c7-8328-9fc309808414 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:09.015513 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-229ffcac-c7e3-42c7-8328-9fc309808414 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1225 microversion: 2.1 time: 0.235254 Jul 30 16:07:09.019857 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 13/34] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:08 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1225 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:09.209927 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c79a655d-0113-402a-b47d-366d35366798 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:09.210540 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c79a655d-0113-402a-b47d-366d35366798 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:09.241317 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c79a655d-0113-402a-b47d-366d35366798 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:09.241776 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c79a655d-0113-402a-b47d-366d35366798 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:09.242794 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c79a655d-0113-402a-b47d-366d35366798 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:09.252683 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c79a655d-0113-402a-b47d-366d35366798 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:09.415105 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c79a655d-0113-402a-b47d-366d35366798 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:09.434662 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c79a655d-0113-402a-b47d-366d35366798 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:09.441756 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c79a655d-0113-402a-b47d-366d35366798 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:09.447480 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c79a655d-0113-402a-b47d-366d35366798 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1285 microversion: 2.20 time: 0.239365 Jul 30 16:07:09.448503 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 22/35] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:09 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1285 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:09.784129 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-75225b51-0a99-4000-8e07-abf14720d61f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:09.784753 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-75225b51-0a99-4000-8e07-abf14720d61f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:09.791478 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-75225b51-0a99-4000-8e07-abf14720d61f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:09.792178 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-75225b51-0a99-4000-8e07-abf14720d61f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:09.793188 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-75225b51-0a99-4000-8e07-abf14720d61f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:09.793842 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-75225b51-0a99-4000-8e07-abf14720d61f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:09.878510 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-2770cab8-ceb6-4206-8bac-d41230e1fc29 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:09.881490 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-2770cab8-ceb6-4206-8bac-d41230e1fc29 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:09.896727 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2770cab8-ceb6-4206-8bac-d41230e1fc29 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:09.897777 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2770cab8-ceb6-4206-8bac-d41230e1fc29 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:09.898354 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2770cab8-ceb6-4206-8bac-d41230e1fc29 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:09.898893 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2770cab8-ceb6-4206-8bac-d41230e1fc29 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:09.968927 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-75225b51-0a99-4000-8e07-abf14720d61f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:09.987840 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-75225b51-0a99-4000-8e07-abf14720d61f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.208127 Jul 30 16:07:09.989707 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 14/36] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:09 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:10.031320 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-2770cab8-ceb6-4206-8bac-d41230e1fc29 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:10.034516 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-22f50f7a-b14f-4b71-b236-bf5869b574e4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:10.038221 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-22f50f7a-b14f-4b71-b236-bf5869b574e4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:10.041423 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-2770cab8-ceb6-4206-8bac-d41230e1fc29 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1240 microversion: 2.1 time: 0.167287 Jul 30 16:07:10.043571 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 23/37] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:09 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1240 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:10.055349 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-22f50f7a-b14f-4b71-b236-bf5869b574e4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:10.056113 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-22f50f7a-b14f-4b71-b236-bf5869b574e4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:10.057207 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-22f50f7a-b14f-4b71-b236-bf5869b574e4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:10.057858 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-22f50f7a-b14f-4b71-b236-bf5869b574e4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:10.194897 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-22f50f7a-b14f-4b71-b236-bf5869b574e4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:10.206294 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-22f50f7a-b14f-4b71-b236-bf5869b574e4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1225 microversion: 2.1 time: 0.172976 Jul 30 16:07:10.216325 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 15/38] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:10 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1225 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:10.468990 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-4f776298-7a1b-4001-a80d-b6afc13d63b8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:10.470314 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-4f776298-7a1b-4001-a80d-b6afc13d63b8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:10.487720 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4f776298-7a1b-4001-a80d-b6afc13d63b8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:10.488618 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4f776298-7a1b-4001-a80d-b6afc13d63b8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:10.489553 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4f776298-7a1b-4001-a80d-b6afc13d63b8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:10.490279 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4f776298-7a1b-4001-a80d-b6afc13d63b8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:10.723952 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-4f776298-7a1b-4001-a80d-b6afc13d63b8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:10.739631 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-4f776298-7a1b-4001-a80d-b6afc13d63b8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:10.741142 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-4f776298-7a1b-4001-a80d-b6afc13d63b8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:10.742234 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-4f776298-7a1b-4001-a80d-b6afc13d63b8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1285 microversion: 2.20 time: 0.277043 Jul 30 16:07:10.742790 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 24/39] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:10 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1285 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:11.005874 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ac63e32e-d945-428f-b0a8-8186e4843800 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:11.006528 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ac63e32e-d945-428f-b0a8-8186e4843800 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:11.013321 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ac63e32e-d945-428f-b0a8-8186e4843800 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:11.013862 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ac63e32e-d945-428f-b0a8-8186e4843800 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:11.014532 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ac63e32e-d945-428f-b0a8-8186e4843800 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:11.014965 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ac63e32e-d945-428f-b0a8-8186e4843800 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:11.065221 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e27f8594-4881-4271-8576-bcbaa90474d5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:11.071331 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e27f8594-4881-4271-8576-bcbaa90474d5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:11.088780 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e27f8594-4881-4271-8576-bcbaa90474d5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:11.092419 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e27f8594-4881-4271-8576-bcbaa90474d5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:11.096704 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e27f8594-4881-4271-8576-bcbaa90474d5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:11.098136 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e27f8594-4881-4271-8576-bcbaa90474d5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:11.218240 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ac63e32e-d945-428f-b0a8-8186e4843800 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:11.231480 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ac63e32e-d945-428f-b0a8-8186e4843800 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.227052 Jul 30 16:07:11.234005 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 16/40] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:10 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:11.234586 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e27f8594-4881-4271-8576-bcbaa90474d5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:11.243703 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f2c87d8c-0bc3-4a6a-a173-4ba45c10db94 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:11.245325 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f2c87d8c-0bc3-4a6a-a173-4ba45c10db94 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:11.253382 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f2c87d8c-0bc3-4a6a-a173-4ba45c10db94 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:11.254095 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f2c87d8c-0bc3-4a6a-a173-4ba45c10db94 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:11.255031 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f2c87d8c-0bc3-4a6a-a173-4ba45c10db94 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:11.255903 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f2c87d8c-0bc3-4a6a-a173-4ba45c10db94 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:11.263065 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e27f8594-4881-4271-8576-bcbaa90474d5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1240 microversion: 2.1 time: 0.203494 Jul 30 16:07:11.293173 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 25/41] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:11 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1240 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:11.363502 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f2c87d8c-0bc3-4a6a-a173-4ba45c10db94 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:11.376654 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f2c87d8c-0bc3-4a6a-a173-4ba45c10db94 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1225 microversion: 2.1 time: 0.140600 Jul 30 16:07:11.377780 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 17/42] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:11 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1225 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:11.761786 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-2082a606-a618-4f2a-9867-0b96f47a69a3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:11.762670 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-2082a606-a618-4f2a-9867-0b96f47a69a3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:11.771642 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2082a606-a618-4f2a-9867-0b96f47a69a3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:11.772451 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2082a606-a618-4f2a-9867-0b96f47a69a3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:11.777313 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2082a606-a618-4f2a-9867-0b96f47a69a3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:11.777932 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2082a606-a618-4f2a-9867-0b96f47a69a3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:11.855233 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-2082a606-a618-4f2a-9867-0b96f47a69a3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:11.868641 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-2082a606-a618-4f2a-9867-0b96f47a69a3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:11.870428 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-2082a606-a618-4f2a-9867-0b96f47a69a3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:11.871733 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-2082a606-a618-4f2a-9867-0b96f47a69a3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1285 microversion: 2.20 time: 0.115128 Jul 30 16:07:11.873015 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 26/43] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:11 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:12.248818 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ce746497-197c-4f69-a6ff-1f2b69f1a4ae tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:12.254119 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ce746497-197c-4f69-a6ff-1f2b69f1a4ae tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:12.259531 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ce746497-197c-4f69-a6ff-1f2b69f1a4ae tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:12.261266 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ce746497-197c-4f69-a6ff-1f2b69f1a4ae tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:12.262219 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ce746497-197c-4f69-a6ff-1f2b69f1a4ae tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:12.263624 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ce746497-197c-4f69-a6ff-1f2b69f1a4ae tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:12.295765 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b3b6fb7b-2673-4c30-98c4-3d232a696c56 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:12.297229 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b3b6fb7b-2673-4c30-98c4-3d232a696c56 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:12.316000 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b3b6fb7b-2673-4c30-98c4-3d232a696c56 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:12.316466 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b3b6fb7b-2673-4c30-98c4-3d232a696c56 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:12.317275 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b3b6fb7b-2673-4c30-98c4-3d232a696c56 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:12.330690 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b3b6fb7b-2673-4c30-98c4-3d232a696c56 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:12.442918 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b3b6fb7b-2673-4c30-98c4-3d232a696c56 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:12.463163 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b3b6fb7b-2673-4c30-98c4-3d232a696c56 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1240 microversion: 2.1 time: 0.178728 Jul 30 16:07:12.466096 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 27/44] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:12 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1240 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:12.480007 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a2c1f217-5539-4b87-9f46-47c816c7859c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:12.481196 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a2c1f217-5539-4b87-9f46-47c816c7859c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:12.488998 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a2c1f217-5539-4b87-9f46-47c816c7859c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:12.489709 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a2c1f217-5539-4b87-9f46-47c816c7859c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:12.490651 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a2c1f217-5539-4b87-9f46-47c816c7859c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:12.491502 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a2c1f217-5539-4b87-9f46-47c816c7859c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:12.542719 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ce746497-197c-4f69-a6ff-1f2b69f1a4ae tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:12.552817 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ce746497-197c-4f69-a6ff-1f2b69f1a4ae tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.307789 Jul 30 16:07:12.554066 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 18/45] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:12 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:12.664481 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-a2c1f217-5539-4b87-9f46-47c816c7859c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:12.673165 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a2c1f217-5539-4b87-9f46-47c816c7859c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1225 microversion: 2.1 time: 0.197019 Jul 30 16:07:12.683374 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 28/46] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:12 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1225 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:12.891597 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-adebbff0-1537-42a2-8cbc-b30674000318 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:12.892481 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-adebbff0-1537-42a2-8cbc-b30674000318 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:12.899647 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-adebbff0-1537-42a2-8cbc-b30674000318 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:12.900105 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-adebbff0-1537-42a2-8cbc-b30674000318 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:12.901103 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-adebbff0-1537-42a2-8cbc-b30674000318 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:12.901540 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-adebbff0-1537-42a2-8cbc-b30674000318 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:12.988483 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-adebbff0-1537-42a2-8cbc-b30674000318 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:13.009662 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-adebbff0-1537-42a2-8cbc-b30674000318 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:13.018255 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-adebbff0-1537-42a2-8cbc-b30674000318 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:13.020533 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-adebbff0-1537-42a2-8cbc-b30674000318 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1285 microversion: 2.20 time: 0.134032 Jul 30 16:07:13.024233 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 19/47] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:12 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:07:13.482085 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-694d532a-a191-4a34-b801-18060d5340d2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:13.482735 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-694d532a-a191-4a34-b801-18060d5340d2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:13.490377 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-694d532a-a191-4a34-b801-18060d5340d2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:13.490838 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-694d532a-a191-4a34-b801-18060d5340d2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:13.491956 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-694d532a-a191-4a34-b801-18060d5340d2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:13.492418 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-694d532a-a191-4a34-b801-18060d5340d2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:13.569385 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-694d532a-a191-4a34-b801-18060d5340d2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:13.574470 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4230e400-90c5-4dce-aa77-85d46c94b06c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:13.575301 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4230e400-90c5-4dce-aa77-85d46c94b06c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:13.582560 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4230e400-90c5-4dce-aa77-85d46c94b06c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:13.582878 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-694d532a-a191-4a34-b801-18060d5340d2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1240 microversion: 2.1 time: 0.102680 Jul 30 16:07:13.583506 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4230e400-90c5-4dce-aa77-85d46c94b06c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:13.598465 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 29/48] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:13 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1240 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:13.600529 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4230e400-90c5-4dce-aa77-85d46c94b06c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:13.601148 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4230e400-90c5-4dce-aa77-85d46c94b06c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:13.696132 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e93b7367-76d4-41ba-b9b9-5468203e1400 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:13.697058 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e93b7367-76d4-41ba-b9b9-5468203e1400 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:13.704176 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e93b7367-76d4-41ba-b9b9-5468203e1400 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:13.704967 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e93b7367-76d4-41ba-b9b9-5468203e1400 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:13.706070 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e93b7367-76d4-41ba-b9b9-5468203e1400 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:13.706915 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e93b7367-76d4-41ba-b9b9-5468203e1400 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:13.771858 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4230e400-90c5-4dce-aa77-85d46c94b06c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:13.776071 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e93b7367-76d4-41ba-b9b9-5468203e1400 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:13.782607 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4230e400-90c5-4dce-aa77-85d46c94b06c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.210347 Jul 30 16:07:13.784169 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 20/49] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:13 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:13.793983 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e93b7367-76d4-41ba-b9b9-5468203e1400 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1225 microversion: 2.1 time: 0.103371 Jul 30 16:07:13.795069 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 30/50] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:13 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:14.041131 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8112afa2-36a7-4f4b-8003-c021e9123c9f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:14.041928 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-8112afa2-36a7-4f4b-8003-c021e9123c9f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:14.059533 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8112afa2-36a7-4f4b-8003-c021e9123c9f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:14.059975 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8112afa2-36a7-4f4b-8003-c021e9123c9f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:14.064047 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8112afa2-36a7-4f4b-8003-c021e9123c9f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:14.067418 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8112afa2-36a7-4f4b-8003-c021e9123c9f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:14.184034 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-8112afa2-36a7-4f4b-8003-c021e9123c9f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:14.204544 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-8112afa2-36a7-4f4b-8003-c021e9123c9f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:14.212754 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-8112afa2-36a7-4f4b-8003-c021e9123c9f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:14.218279 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8112afa2-36a7-4f4b-8003-c021e9123c9f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1285 microversion: 2.20 time: 0.178917 Jul 30 16:07:14.218279 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 21/51] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:14 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:14.600349 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-97a12bc7-47a1-4191-a1f6-34622b3ecf39 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:14.601788 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-97a12bc7-47a1-4191-a1f6-34622b3ecf39 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:14.610453 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-97a12bc7-47a1-4191-a1f6-34622b3ecf39 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:14.610959 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-97a12bc7-47a1-4191-a1f6-34622b3ecf39 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:14.612575 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-97a12bc7-47a1-4191-a1f6-34622b3ecf39 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:14.613210 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-97a12bc7-47a1-4191-a1f6-34622b3ecf39 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:14.733493 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-97a12bc7-47a1-4191-a1f6-34622b3ecf39 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:14.743407 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-97a12bc7-47a1-4191-a1f6-34622b3ecf39 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1240 microversion: 2.1 time: 0.145893 Jul 30 16:07:14.744004 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 31/52] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:14 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1240 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:14.800667 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-6eaa97e7-204a-43a4-b07a-8eba1984d2d3 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:14.801293 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-6eaa97e7-204a-43a4-b07a-8eba1984d2d3 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:14.812001 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ecd1c1ed-bf4c-4697-bd87-be986f77209f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:14.812625 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ecd1c1ed-bf4c-4697-bd87-be986f77209f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:14.823836 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6eaa97e7-204a-43a4-b07a-8eba1984d2d3 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:14.825344 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6eaa97e7-204a-43a4-b07a-8eba1984d2d3 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:14.826314 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6eaa97e7-204a-43a4-b07a-8eba1984d2d3 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:14.827396 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ecd1c1ed-bf4c-4697-bd87-be986f77209f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:14.829108 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6eaa97e7-204a-43a4-b07a-8eba1984d2d3 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:14.836848 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ecd1c1ed-bf4c-4697-bd87-be986f77209f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:14.838567 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ecd1c1ed-bf4c-4697-bd87-be986f77209f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:14.839368 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ecd1c1ed-bf4c-4697-bd87-be986f77209f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:14.973120 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-ecd1c1ed-bf4c-4697-bd87-be986f77209f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:14.976306 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6eaa97e7-204a-43a4-b07a-8eba1984d2d3 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:14.982703 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ecd1c1ed-bf4c-4697-bd87-be986f77209f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1225 microversion: 2.1 time: 0.174147 Jul 30 16:07:14.988092 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-6eaa97e7-204a-43a4-b07a-8eba1984d2d3 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.191985 Jul 30 16:07:14.995350 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 22/53] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:14 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:14.997162 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 32/54] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:14 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1225 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:15.244762 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-24b246c2-e760-4652-98f1-a45efc5e37fe tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:15.245388 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-24b246c2-e760-4652-98f1-a45efc5e37fe tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:15.254428 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-24b246c2-e760-4652-98f1-a45efc5e37fe tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:15.255087 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-24b246c2-e760-4652-98f1-a45efc5e37fe tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:15.255908 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-24b246c2-e760-4652-98f1-a45efc5e37fe tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:15.256349 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-24b246c2-e760-4652-98f1-a45efc5e37fe tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:15.341264 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-24b246c2-e760-4652-98f1-a45efc5e37fe tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:15.354526 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-24b246c2-e760-4652-98f1-a45efc5e37fe tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:15.356739 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-24b246c2-e760-4652-98f1-a45efc5e37fe tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:15.358136 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-24b246c2-e760-4652-98f1-a45efc5e37fe tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1285 microversion: 2.20 time: 0.123956 Jul 30 16:07:15.369058 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 23/55] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:15 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:15.760808 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-119aff34-5b4d-4aab-995e-ee1aa020a23a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:15.761566 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-119aff34-5b4d-4aab-995e-ee1aa020a23a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:15.779436 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-119aff34-5b4d-4aab-995e-ee1aa020a23a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:15.779886 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-119aff34-5b4d-4aab-995e-ee1aa020a23a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:15.780762 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-119aff34-5b4d-4aab-995e-ee1aa020a23a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:15.781105 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-119aff34-5b4d-4aab-995e-ee1aa020a23a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:15.878911 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-119aff34-5b4d-4aab-995e-ee1aa020a23a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:15.893543 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-119aff34-5b4d-4aab-995e-ee1aa020a23a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1240 microversion: 2.1 time: 0.136236 Jul 30 16:07:15.894780 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 33/56] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:15 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1240 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:16.001983 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ab17453e-73d6-440f-b764-d66d7b34233d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:16.002728 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ab17453e-73d6-440f-b764-d66d7b34233d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:16.005915 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-74b944db-dbf3-4b74-8630-12e21c40510d tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:16.006674 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-74b944db-dbf3-4b74-8630-12e21c40510d tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:16.011439 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ab17453e-73d6-440f-b764-d66d7b34233d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:16.012133 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ab17453e-73d6-440f-b764-d66d7b34233d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:16.012930 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ab17453e-73d6-440f-b764-d66d7b34233d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:16.013384 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ab17453e-73d6-440f-b764-d66d7b34233d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:16.024421 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-74b944db-dbf3-4b74-8630-12e21c40510d tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:16.025035 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-74b944db-dbf3-4b74-8630-12e21c40510d tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:16.025929 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-74b944db-dbf3-4b74-8630-12e21c40510d tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:16.026473 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-74b944db-dbf3-4b74-8630-12e21c40510d tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:16.175605 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ab17453e-73d6-440f-b764-d66d7b34233d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:16.189991 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ab17453e-73d6-440f-b764-d66d7b34233d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1225 microversion: 2.1 time: 0.192945 Jul 30 16:07:16.190551 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 24/57] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:15 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1225 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:16.234103 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-74b944db-dbf3-4b74-8630-12e21c40510d tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:16.246787 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-74b944db-dbf3-4b74-8630-12e21c40510d tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.244542 Jul 30 16:07:16.247175 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 34/58] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:16 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:16.380632 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9914cfa0-662c-444a-8ef6-d682eca830d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:16.381558 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9914cfa0-662c-444a-8ef6-d682eca830d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:16.389191 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9914cfa0-662c-444a-8ef6-d682eca830d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:16.389900 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9914cfa0-662c-444a-8ef6-d682eca830d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:16.390683 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9914cfa0-662c-444a-8ef6-d682eca830d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:16.391470 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9914cfa0-662c-444a-8ef6-d682eca830d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:16.456287 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9914cfa0-662c-444a-8ef6-d682eca830d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:16.464852 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9914cfa0-662c-444a-8ef6-d682eca830d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:16.466414 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9914cfa0-662c-444a-8ef6-d682eca830d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:16.467528 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9914cfa0-662c-444a-8ef6-d682eca830d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1285 microversion: 2.20 time: 0.095124 Jul 30 16:07:16.468083 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 25/59] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:16 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:16.916200 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ec1ac9ca-00e5-4ee1-b8de-d2eecf806fbe tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:16.916822 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ec1ac9ca-00e5-4ee1-b8de-d2eecf806fbe tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:16.926680 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ec1ac9ca-00e5-4ee1-b8de-d2eecf806fbe tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:16.927505 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ec1ac9ca-00e5-4ee1-b8de-d2eecf806fbe tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:16.928555 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ec1ac9ca-00e5-4ee1-b8de-d2eecf806fbe tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:16.929254 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ec1ac9ca-00e5-4ee1-b8de-d2eecf806fbe tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:17.010156 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-ec1ac9ca-00e5-4ee1-b8de-d2eecf806fbe tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:17.020177 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ec1ac9ca-00e5-4ee1-b8de-d2eecf806fbe tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1240 microversion: 2.1 time: 0.110441 Jul 30 16:07:17.020998 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 35/60] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:16 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1240 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:17.206893 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a5f1943b-a477-43a1-8744-e452d941f8f6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:17.209578 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a5f1943b-a477-43a1-8744-e452d941f8f6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:17.221814 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a5f1943b-a477-43a1-8744-e452d941f8f6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:17.221814 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a5f1943b-a477-43a1-8744-e452d941f8f6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:17.223122 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a5f1943b-a477-43a1-8744-e452d941f8f6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:17.224059 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a5f1943b-a477-43a1-8744-e452d941f8f6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:17.264186 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-63f10b41-0568-4415-92c5-c4e081d7f191 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:17.264830 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-63f10b41-0568-4415-92c5-c4e081d7f191 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:17.276357 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-63f10b41-0568-4415-92c5-c4e081d7f191 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:17.276828 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-63f10b41-0568-4415-92c5-c4e081d7f191 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:17.277623 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-63f10b41-0568-4415-92c5-c4e081d7f191 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:17.278087 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-63f10b41-0568-4415-92c5-c4e081d7f191 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:17.369892 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a5f1943b-a477-43a1-8744-e452d941f8f6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:17.389956 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a5f1943b-a477-43a1-8744-e452d941f8f6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1225 microversion: 2.1 time: 0.186995 Jul 30 16:07:17.392138 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 26/61] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:17 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1225 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:17.488772 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0cdacd10-bf1d-4f27-8c9e-bea378ed17da tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:17.489688 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0cdacd10-bf1d-4f27-8c9e-bea378ed17da tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:17.495766 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0cdacd10-bf1d-4f27-8c9e-bea378ed17da tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:17.496456 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0cdacd10-bf1d-4f27-8c9e-bea378ed17da tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:17.497415 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0cdacd10-bf1d-4f27-8c9e-bea378ed17da tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:17.497977 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0cdacd10-bf1d-4f27-8c9e-bea378ed17da tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:17.601551 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0cdacd10-bf1d-4f27-8c9e-bea378ed17da tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:17.601798 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-63f10b41-0568-4415-92c5-c4e081d7f191 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:17.617914 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-63f10b41-0568-4415-92c5-c4e081d7f191 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.353340 Jul 30 16:07:17.618236 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0cdacd10-bf1d-4f27-8c9e-bea378ed17da tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:17.618236 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0cdacd10-bf1d-4f27-8c9e-bea378ed17da tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:17.618236 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0cdacd10-bf1d-4f27-8c9e-bea378ed17da tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1285 microversion: 2.20 time: 0.135028 Jul 30 16:07:17.619330 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 27/62] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:17 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:17.624536 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 36/63] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:17 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:18.038549 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-14232dba-05f4-43ff-a664-02af62448a12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:18.039382 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-14232dba-05f4-43ff-a664-02af62448a12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:18.049035 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-14232dba-05f4-43ff-a664-02af62448a12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:18.049478 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-14232dba-05f4-43ff-a664-02af62448a12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:18.050432 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-14232dba-05f4-43ff-a664-02af62448a12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:18.050876 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-14232dba-05f4-43ff-a664-02af62448a12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:18.139830 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-14232dba-05f4-43ff-a664-02af62448a12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:18.149689 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-14232dba-05f4-43ff-a664-02af62448a12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1240 microversion: 2.1 time: 0.116193 Jul 30 16:07:18.151069 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 28/64] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:18 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1240 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:18.416366 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-cee97c51-6db4-435a-a8cc-28fae80ea25a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:18.417863 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-cee97c51-6db4-435a-a8cc-28fae80ea25a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:18.427636 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cee97c51-6db4-435a-a8cc-28fae80ea25a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:18.432373 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cee97c51-6db4-435a-a8cc-28fae80ea25a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:18.435088 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cee97c51-6db4-435a-a8cc-28fae80ea25a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:18.435712 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cee97c51-6db4-435a-a8cc-28fae80ea25a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:18.530084 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-cee97c51-6db4-435a-a8cc-28fae80ea25a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:18.536750 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-cee97c51-6db4-435a-a8cc-28fae80ea25a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1217 microversion: 2.1 time: 0.124480 Jul 30 16:07:18.537407 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 37/65] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:18 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:18.630809 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0f25ab5a-1b56-4090-93c4-85b1e6150f20 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:18.632832 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0f25ab5a-1b56-4090-93c4-85b1e6150f20 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:18.637780 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ab22d8fa-bdc4-4a0e-88ae-899c25ee8180 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:18.638387 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ab22d8fa-bdc4-4a0e-88ae-899c25ee8180 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:18.649560 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ab22d8fa-bdc4-4a0e-88ae-899c25ee8180 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:18.650013 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ab22d8fa-bdc4-4a0e-88ae-899c25ee8180 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:18.650980 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ab22d8fa-bdc4-4a0e-88ae-899c25ee8180 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:18.651487 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0f25ab5a-1b56-4090-93c4-85b1e6150f20 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:18.651770 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ab22d8fa-bdc4-4a0e-88ae-899c25ee8180 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:18.652808 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0f25ab5a-1b56-4090-93c4-85b1e6150f20 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:18.655121 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0f25ab5a-1b56-4090-93c4-85b1e6150f20 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:18.658164 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0f25ab5a-1b56-4090-93c4-85b1e6150f20 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:18.727996 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-ab22d8fa-bdc4-4a0e-88ae-899c25ee8180 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:18.736073 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-ab22d8fa-bdc4-4a0e-88ae-899c25ee8180 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:18.751313 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-ab22d8fa-bdc4-4a0e-88ae-899c25ee8180 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:18.752992 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ab22d8fa-bdc4-4a0e-88ae-899c25ee8180 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1277 microversion: 2.20 time: 0.118961 Jul 30 16:07:18.753742 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 38/66] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:18 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1277 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:07:18.942185 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0f25ab5a-1b56-4090-93c4-85b1e6150f20 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:18.949341 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0f25ab5a-1b56-4090-93c4-85b1e6150f20 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.322172 Jul 30 16:07:18.949901 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 29/67] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:18 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:19.174382 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6c63c5a0-c775-40cb-9e79-3aa40a341cc8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:19.176103 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6c63c5a0-c775-40cb-9e79-3aa40a341cc8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:19.202917 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6c63c5a0-c775-40cb-9e79-3aa40a341cc8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:19.203905 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6c63c5a0-c775-40cb-9e79-3aa40a341cc8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:19.205420 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6c63c5a0-c775-40cb-9e79-3aa40a341cc8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:19.206119 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6c63c5a0-c775-40cb-9e79-3aa40a341cc8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:19.421484 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6c63c5a0-c775-40cb-9e79-3aa40a341cc8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:19.432791 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6c63c5a0-c775-40cb-9e79-3aa40a341cc8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1232 microversion: 2.1 time: 0.266218 Jul 30 16:07:19.433386 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 39/68] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:19 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1232 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:19.554065 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d1c369f5-4607-41e9-989c-cfb4f74d00ee tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:19.555070 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d1c369f5-4607-41e9-989c-cfb4f74d00ee tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:19.566555 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d1c369f5-4607-41e9-989c-cfb4f74d00ee tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:19.568137 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d1c369f5-4607-41e9-989c-cfb4f74d00ee tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:19.570892 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d1c369f5-4607-41e9-989c-cfb4f74d00ee tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:19.571584 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d1c369f5-4607-41e9-989c-cfb4f74d00ee tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:19.726578 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d1c369f5-4607-41e9-989c-cfb4f74d00ee tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:19.739262 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d1c369f5-4607-41e9-989c-cfb4f74d00ee tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1279 microversion: 2.1 time: 0.188582 Jul 30 16:07:19.740445 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 30/69] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:19 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1279 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:19.773934 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-83dc5547-8fe4-470d-8ded-bc4b4bfa6f0a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:19.774664 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-83dc5547-8fe4-470d-8ded-bc4b4bfa6f0a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:19.781646 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-83dc5547-8fe4-470d-8ded-bc4b4bfa6f0a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:19.782570 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-83dc5547-8fe4-470d-8ded-bc4b4bfa6f0a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:19.783876 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-83dc5547-8fe4-470d-8ded-bc4b4bfa6f0a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:19.784732 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-83dc5547-8fe4-470d-8ded-bc4b4bfa6f0a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:19.968184 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-56a643a1-666f-4e78-8127-bbc925b86426 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:19.968798 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-56a643a1-666f-4e78-8127-bbc925b86426 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:19.977406 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56a643a1-666f-4e78-8127-bbc925b86426 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:19.979096 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56a643a1-666f-4e78-8127-bbc925b86426 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:19.980738 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56a643a1-666f-4e78-8127-bbc925b86426 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:19.982636 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56a643a1-666f-4e78-8127-bbc925b86426 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:20.063995 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-83dc5547-8fe4-470d-8ded-bc4b4bfa6f0a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:20.074080 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-83dc5547-8fe4-470d-8ded-bc4b4bfa6f0a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:20.078142 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-83dc5547-8fe4-470d-8ded-bc4b4bfa6f0a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:20.080798 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-83dc5547-8fe4-470d-8ded-bc4b4bfa6f0a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1333 microversion: 2.20 time: 0.312896 Jul 30 16:07:20.084542 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 40/70] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:19 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1333 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:20.415420 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-bba5b6da-5ee7-459f-8f6b-2c12d3441636 req-d7a6c85c-0b32-486c-a949-dea8fda02727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e26181d7-db01-409a-af4d-e60ceed08514", "tag": "2722991c-02f6-4d1b-a307-ec06cfcdb383"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:20.417694 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:07:20.417694 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:07:20.460692 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-bba5b6da-5ee7-459f-8f6b-2c12d3441636 req-d7a6c85c-0b32-486c-a949-dea8fda02727 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:20.462680 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-bba5b6da-5ee7-459f-8f6b-2c12d3441636 req-d7a6c85c-0b32-486c-a949-dea8fda02727 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:20.534286 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-bba5b6da-5ee7-459f-8f6b-2c12d3441636 req-d7a6c85c-0b32-486c-a949-dea8fda02727 service nova] Creating event network-changed:2722991c-02f6-4d1b-a307-ec06cfcdb383 for instance e26181d7-db01-409a-af4d-e60ceed08514 on hv-cinder-80304 Jul 30 16:07:20.536177 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-bba5b6da-5ee7-459f-8f6b-2c12d3441636 req-d7a6c85c-0b32-486c-a949-dea8fda02727 service nova] Acquired lock "compute-rpcapi-router" {{(pid=107452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 30 16:07:20.538694 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d532e589-0230-4330-b157-81bd42d0249c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:20.540794 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d532e589-0230-4330-b157-81bd42d0249c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:20.542075 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d532e589-0230-4330-b157-81bd42d0249c None None] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:20.543505 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d532e589-0230-4330-b157-81bd42d0249c None None] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:20.557563 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.compute.rpcapi [None req-d532e589-0230-4330-b157-81bd42d0249c None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jul 30 16:07:20.563335 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d532e589-0230-4330-b157-81bd42d0249c None None] Releasing lock "compute-rpcapi-router" {{(pid=107452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 30 16:07:20.612060 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-56a643a1-666f-4e78-8127-bbc925b86426 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:20.620862 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-56a643a1-666f-4e78-8127-bbc925b86426 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.656615 Jul 30 16:07:20.621445 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 31/71] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:19 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:20.634343 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0b00a97d-32e4-45d4-b707-cfad7254d1c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:20.640374 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0b00a97d-32e4-45d4-b707-cfad7254d1c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:20.649021 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d532e589-0230-4330-b157-81bd42d0249c None None] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.531099 Jul 30 16:07:20.650257 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 41/72] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:07:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:07:20.653412 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0b00a97d-32e4-45d4-b707-cfad7254d1c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:20.654049 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0b00a97d-32e4-45d4-b707-cfad7254d1c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:20.655021 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0b00a97d-32e4-45d4-b707-cfad7254d1c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:20.655797 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0b00a97d-32e4-45d4-b707-cfad7254d1c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:20.757334 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-de18072c-7bb9-4f32-b633-6de6486d7711 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:20.758042 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-de18072c-7bb9-4f32-b633-6de6486d7711 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:20.763624 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0b00a97d-32e4-45d4-b707-cfad7254d1c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:20.772654 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0b00a97d-32e4-45d4-b707-cfad7254d1c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1288 microversion: 2.1 time: 0.146510 Jul 30 16:07:20.777842 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-de18072c-7bb9-4f32-b633-6de6486d7711 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:20.778295 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-de18072c-7bb9-4f32-b633-6de6486d7711 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:20.779089 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-de18072c-7bb9-4f32-b633-6de6486d7711 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:20.779564 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-de18072c-7bb9-4f32-b633-6de6486d7711 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:20.792507 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 32/73] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:20 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1288 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:21.100817 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-39206b16-549b-438f-a60b-2345c1f2767a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:21.101782 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-39206b16-549b-438f-a60b-2345c1f2767a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:21.115401 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-39206b16-549b-438f-a60b-2345c1f2767a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:21.117104 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-39206b16-549b-438f-a60b-2345c1f2767a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:21.118272 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-39206b16-549b-438f-a60b-2345c1f2767a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:21.120910 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-39206b16-549b-438f-a60b-2345c1f2767a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:21.153897 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-de18072c-7bb9-4f32-b633-6de6486d7711 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:21.167195 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-de18072c-7bb9-4f32-b633-6de6486d7711 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1321 microversion: 2.1 time: 0.410792 Jul 30 16:07:21.168144 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 42/74] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:20 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1321 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:21.348986 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-39206b16-549b-438f-a60b-2345c1f2767a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:21.360470 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-39206b16-549b-438f-a60b-2345c1f2767a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:21.362834 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-39206b16-549b-438f-a60b-2345c1f2767a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:21.364569 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-39206b16-549b-438f-a60b-2345c1f2767a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1339 microversion: 2.20 time: 0.268595 Jul 30 16:07:21.365287 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 33/75] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:21 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1339 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:07:21.642751 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9da05499-44e5-45ad-b3e6-7bdd599a747f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:21.644025 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9da05499-44e5-45ad-b3e6-7bdd599a747f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:21.652431 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9da05499-44e5-45ad-b3e6-7bdd599a747f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:21.653639 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9da05499-44e5-45ad-b3e6-7bdd599a747f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:21.654687 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9da05499-44e5-45ad-b3e6-7bdd599a747f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:21.655902 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9da05499-44e5-45ad-b3e6-7bdd599a747f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:21.792026 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c2a7c3f4-d552-46a6-8b02-370ad5975b93 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:21.792643 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c2a7c3f4-d552-46a6-8b02-370ad5975b93 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:21.809130 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c2a7c3f4-d552-46a6-8b02-370ad5975b93 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:21.809559 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c2a7c3f4-d552-46a6-8b02-370ad5975b93 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:21.810364 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c2a7c3f4-d552-46a6-8b02-370ad5975b93 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:21.810805 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c2a7c3f4-d552-46a6-8b02-370ad5975b93 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:22.021153 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c2a7c3f4-d552-46a6-8b02-370ad5975b93 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:22.028713 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c2a7c3f4-d552-46a6-8b02-370ad5975b93 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1294 microversion: 2.1 time: 0.240294 Jul 30 16:07:22.030177 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 34/76] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:21 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1294 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:22.167640 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9da05499-44e5-45ad-b3e6-7bdd599a747f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:22.175506 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9da05499-44e5-45ad-b3e6-7bdd599a747f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.541192 Jul 30 16:07:22.177194 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 43/77] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:21 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:22.193636 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1f33ab1c-847a-4f96-b981-95fc6de7d2da tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:22.194260 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1f33ab1c-847a-4f96-b981-95fc6de7d2da tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:22.201940 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1f33ab1c-847a-4f96-b981-95fc6de7d2da tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:22.202857 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1f33ab1c-847a-4f96-b981-95fc6de7d2da tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:22.204555 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1f33ab1c-847a-4f96-b981-95fc6de7d2da tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:22.205504 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1f33ab1c-847a-4f96-b981-95fc6de7d2da tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:22.389155 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e60ae286-dade-4f4e-901a-6e43c6c6aeb9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:22.389828 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e60ae286-dade-4f4e-901a-6e43c6c6aeb9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:22.399166 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e60ae286-dade-4f4e-901a-6e43c6c6aeb9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:22.399766 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e60ae286-dade-4f4e-901a-6e43c6c6aeb9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:22.401401 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e60ae286-dade-4f4e-901a-6e43c6c6aeb9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:22.402259 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e60ae286-dade-4f4e-901a-6e43c6c6aeb9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:22.846180 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e60ae286-dade-4f4e-901a-6e43c6c6aeb9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:22.860536 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e60ae286-dade-4f4e-901a-6e43c6c6aeb9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:22.867478 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e60ae286-dade-4f4e-901a-6e43c6c6aeb9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:22.871376 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e60ae286-dade-4f4e-901a-6e43c6c6aeb9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.486989 Jul 30 16:07:22.881256 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 44/78] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:22 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:07:23.010543 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1f33ab1c-847a-4f96-b981-95fc6de7d2da tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:23.025679 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1f33ab1c-847a-4f96-b981-95fc6de7d2da tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1321 microversion: 2.1 time: 0.841503 Jul 30 16:07:23.028223 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 35/79] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:22 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1321 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:23.052891 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-cc5a1576-7d1d-4532-8a1b-847ec89cc6e2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:23.053774 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-cc5a1576-7d1d-4532-8a1b-847ec89cc6e2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:23.071967 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cc5a1576-7d1d-4532-8a1b-847ec89cc6e2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:23.072916 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cc5a1576-7d1d-4532-8a1b-847ec89cc6e2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:23.073821 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cc5a1576-7d1d-4532-8a1b-847ec89cc6e2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:23.074479 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cc5a1576-7d1d-4532-8a1b-847ec89cc6e2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:23.206845 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d16a438b-85f6-4526-84f7-2351af2cc74f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:23.207930 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d16a438b-85f6-4526-84f7-2351af2cc74f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:23.223861 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d16a438b-85f6-4526-84f7-2351af2cc74f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:23.225653 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d16a438b-85f6-4526-84f7-2351af2cc74f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:23.242762 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d16a438b-85f6-4526-84f7-2351af2cc74f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:23.245182 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d16a438b-85f6-4526-84f7-2351af2cc74f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:23.444759 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-cc5a1576-7d1d-4532-8a1b-847ec89cc6e2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:23.455840 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-cc5a1576-7d1d-4532-8a1b-847ec89cc6e2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1294 microversion: 2.1 time: 0.408465 Jul 30 16:07:23.457051 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 45/80] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:23 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1294 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:23.541714 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-7f9fab4f-1608-477d-b9aa-f3fe7eb6dd1a req-2c801c83-1d6a-4fa1-98cb-a55e73dff1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06b40b08-b26d-408a-a189-89e1abad5e88", "tag": "b7c2f2ac-ee9c-4c0b-9449-d350635bd2d0"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:23.545410 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:07:23.545410 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:07:23.556066 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-7f9fab4f-1608-477d-b9aa-f3fe7eb6dd1a req-2c801c83-1d6a-4fa1-98cb-a55e73dff1a6 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:23.556851 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-7f9fab4f-1608-477d-b9aa-f3fe7eb6dd1a req-2c801c83-1d6a-4fa1-98cb-a55e73dff1a6 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:23.568924 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-7f9fab4f-1608-477d-b9aa-f3fe7eb6dd1a req-2c801c83-1d6a-4fa1-98cb-a55e73dff1a6 service nova] Creating event network-changed:b7c2f2ac-ee9c-4c0b-9449-d350635bd2d0 for instance 06b40b08-b26d-408a-a189-89e1abad5e88 on hv-cinder-80304 Jul 30 16:07:23.575828 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-7f9fab4f-1608-477d-b9aa-f3fe7eb6dd1a req-2c801c83-1d6a-4fa1-98cb-a55e73dff1a6 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116897 Jul 30 16:07:23.577160 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 46/81] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:07:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:07:23.711944 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d16a438b-85f6-4526-84f7-2351af2cc74f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:23.726008 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d16a438b-85f6-4526-84f7-2351af2cc74f tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.529160 Jul 30 16:07:23.726669 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 36/82] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:23 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:23.889242 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-63b47178-15e8-4fbe-b5b3-29393b331568 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:23.892055 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-63b47178-15e8-4fbe-b5b3-29393b331568 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:23.909544 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-63b47178-15e8-4fbe-b5b3-29393b331568 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:23.915602 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-63b47178-15e8-4fbe-b5b3-29393b331568 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:23.918060 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-63b47178-15e8-4fbe-b5b3-29393b331568 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:23.920145 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-63b47178-15e8-4fbe-b5b3-29393b331568 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:24.046142 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3affb3e5-df32-42c3-a78b-4bf7a482ac04 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:24.048099 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-3affb3e5-df32-42c3-a78b-4bf7a482ac04 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:24.074330 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3affb3e5-df32-42c3-a78b-4bf7a482ac04 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:24.075045 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3affb3e5-df32-42c3-a78b-4bf7a482ac04 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:24.078088 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3affb3e5-df32-42c3-a78b-4bf7a482ac04 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:24.080188 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3affb3e5-df32-42c3-a78b-4bf7a482ac04 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:24.425105 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-63b47178-15e8-4fbe-b5b3-29393b331568 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:24.433281 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-63b47178-15e8-4fbe-b5b3-29393b331568 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:24.442176 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-63b47178-15e8-4fbe-b5b3-29393b331568 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:24.444043 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-63b47178-15e8-4fbe-b5b3-29393b331568 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.559351 Jul 30 16:07:24.447448 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 47/83] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:23 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:24.482130 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8a59d93d-3d05-48fb-bb1b-65d212586b81 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:24.482946 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8a59d93d-3d05-48fb-bb1b-65d212586b81 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:24.494943 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8a59d93d-3d05-48fb-bb1b-65d212586b81 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:24.495333 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8a59d93d-3d05-48fb-bb1b-65d212586b81 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:24.496129 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8a59d93d-3d05-48fb-bb1b-65d212586b81 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:24.496571 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8a59d93d-3d05-48fb-bb1b-65d212586b81 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:24.536564 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3affb3e5-df32-42c3-a78b-4bf7a482ac04 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:24.544728 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-3affb3e5-df32-42c3-a78b-4bf7a482ac04 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1321 microversion: 2.1 time: 0.503467 Jul 30 16:07:24.545307 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 37/84] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:24 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1321 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:24.744358 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-bbf76de3-6712-4d30-ac1f-65991da2f749 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:24.745283 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-bbf76de3-6712-4d30-ac1f-65991da2f749 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:24.753169 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bbf76de3-6712-4d30-ac1f-65991da2f749 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:24.754185 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bbf76de3-6712-4d30-ac1f-65991da2f749 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:24.755434 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bbf76de3-6712-4d30-ac1f-65991da2f749 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:24.756307 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bbf76de3-6712-4d30-ac1f-65991da2f749 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:24.960952 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8a59d93d-3d05-48fb-bb1b-65d212586b81 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:24.973860 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8a59d93d-3d05-48fb-bb1b-65d212586b81 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.495868 Jul 30 16:07:24.983512 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 48/85] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:24 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:25.037962 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-9bce3350-e50f-4320-a686-c9d82601cde5 req-f0718749-fbb5-4501-9eeb-9ad16bc283c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f429942e-bf01-4d55-9cb0-29cdf5d6fef6", "tag": "4f9fcb96-116b-472f-84aa-c777e2358cb4"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:25.042371 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:07:25.042371 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:07:25.060874 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-9bce3350-e50f-4320-a686-c9d82601cde5 req-f0718749-fbb5-4501-9eeb-9ad16bc283c9 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:25.063413 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-9bce3350-e50f-4320-a686-c9d82601cde5 req-f0718749-fbb5-4501-9eeb-9ad16bc283c9 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:25.116756 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-9bce3350-e50f-4320-a686-c9d82601cde5 req-f0718749-fbb5-4501-9eeb-9ad16bc283c9 service nova] Creating event network-changed:4f9fcb96-116b-472f-84aa-c777e2358cb4 for instance f429942e-bf01-4d55-9cb0-29cdf5d6fef6 on hv-cinder-80304 Jul 30 16:07:25.133963 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-9bce3350-e50f-4320-a686-c9d82601cde5 req-f0718749-fbb5-4501-9eeb-9ad16bc283c9 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124549 Jul 30 16:07:25.138342 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 49/86] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:07:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:07:25.174695 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-bbf76de3-6712-4d30-ac1f-65991da2f749 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:25.187420 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-bbf76de3-6712-4d30-ac1f-65991da2f749 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.446157 Jul 30 16:07:25.188693 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 38/87] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:24 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:25.468191 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8cde9df9-8faa-496b-bb4f-3ee5a6ba5a5a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:25.470747 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8cde9df9-8faa-496b-bb4f-3ee5a6ba5a5a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:25.515407 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8cde9df9-8faa-496b-bb4f-3ee5a6ba5a5a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:25.519670 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8cde9df9-8faa-496b-bb4f-3ee5a6ba5a5a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:25.520733 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8cde9df9-8faa-496b-bb4f-3ee5a6ba5a5a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:25.524012 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8cde9df9-8faa-496b-bb4f-3ee5a6ba5a5a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:25.564341 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b6ad7b4b-9ba8-412e-91c5-79e7e0c3766b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:25.564963 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b6ad7b4b-9ba8-412e-91c5-79e7e0c3766b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:25.578111 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b6ad7b4b-9ba8-412e-91c5-79e7e0c3766b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:25.579100 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b6ad7b4b-9ba8-412e-91c5-79e7e0c3766b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:25.580150 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b6ad7b4b-9ba8-412e-91c5-79e7e0c3766b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:25.592597 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b6ad7b4b-9ba8-412e-91c5-79e7e0c3766b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:26.340827 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b6ad7b4b-9ba8-412e-91c5-79e7e0c3766b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:26.348811 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b6ad7b4b-9ba8-412e-91c5-79e7e0c3766b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1321 microversion: 2.1 time: 0.788752 Jul 30 16:07:26.349386 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 39/88] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:25 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1321 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:26.353742 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-78fa5e59-e54a-45b2-bf68-56922e4c0f21 req-785ca093-137d-4e88-95df-a256e8d633e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb", "tag": "9138d528-69f5-4703-ba07-6f85b67dc617"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:26.363641 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:07:26.363641 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:07:26.385354 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-78fa5e59-e54a-45b2-bf68-56922e4c0f21 req-785ca093-137d-4e88-95df-a256e8d633e7 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:26.387477 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-78fa5e59-e54a-45b2-bf68-56922e4c0f21 req-785ca093-137d-4e88-95df-a256e8d633e7 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:26.404543 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8cde9df9-8faa-496b-bb4f-3ee5a6ba5a5a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:26.413487 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8cde9df9-8faa-496b-bb4f-3ee5a6ba5a5a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:26.436645 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8cde9df9-8faa-496b-bb4f-3ee5a6ba5a5a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:26.436645 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8cde9df9-8faa-496b-bb4f-3ee5a6ba5a5a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.966614 Jul 30 16:07:26.436645 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 50/89] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:25 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:26.440610 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-78fa5e59-e54a-45b2-bf68-56922e4c0f21 req-785ca093-137d-4e88-95df-a256e8d633e7 service nova] Creating event network-changed:9138d528-69f5-4703-ba07-6f85b67dc617 for instance ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb on hv-cinder-80304 Jul 30 16:07:26.441139 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-78fa5e59-e54a-45b2-bf68-56922e4c0f21 req-785ca093-137d-4e88-95df-a256e8d633e7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=107453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 30 16:07:26.442606 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-66b0ba3f-4da3-4a82-b0d0-d290fa574405 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:26.443045 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-66b0ba3f-4da3-4a82-b0d0-d290fa574405 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:26.444102 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-66b0ba3f-4da3-4a82-b0d0-d290fa574405 None None] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:26.444736 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-66b0ba3f-4da3-4a82-b0d0-d290fa574405 None None] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:26.455800 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-062c5cb9-1422-412e-b34e-c266256fa119 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:26.456456 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-062c5cb9-1422-412e-b34e-c266256fa119 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:26.460618 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.compute.rpcapi [None req-66b0ba3f-4da3-4a82-b0d0-d290fa574405 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jul 30 16:07:26.461747 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-66b0ba3f-4da3-4a82-b0d0-d290fa574405 None None] Releasing lock "compute-rpcapi-router" {{(pid=107453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 30 16:07:26.477735 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-062c5cb9-1422-412e-b34e-c266256fa119 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:26.478190 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-062c5cb9-1422-412e-b34e-c266256fa119 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:26.478970 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-062c5cb9-1422-412e-b34e-c266256fa119 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:26.491298 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-062c5cb9-1422-412e-b34e-c266256fa119 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:26.511004 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-66b0ba3f-4da3-4a82-b0d0-d290fa574405 None None] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160378 Jul 30 16:07:26.511645 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 40/90] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:07:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:07:26.517586 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f640878e-0e56-4068-8cee-239445e6e7b8 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:26.519187 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f640878e-0e56-4068-8cee-239445e6e7b8 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:26.525966 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f640878e-0e56-4068-8cee-239445e6e7b8 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:26.526495 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f640878e-0e56-4068-8cee-239445e6e7b8 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:26.527386 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f640878e-0e56-4068-8cee-239445e6e7b8 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:26.528021 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f640878e-0e56-4068-8cee-239445e6e7b8 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:26.698418 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f640878e-0e56-4068-8cee-239445e6e7b8 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:26.708594 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f640878e-0e56-4068-8cee-239445e6e7b8 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.195423 Jul 30 16:07:26.709290 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 41/91] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:26 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:26.720920 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-062c5cb9-1422-412e-b34e-c266256fa119 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:26.729299 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-062c5cb9-1422-412e-b34e-c266256fa119 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.287682 Jul 30 16:07:26.729855 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 51/92] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:26 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:27.156403 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-146188c1-01b9-4372-9c74-b072fbd4cc33 req-dc5f7b38-8252-4751-bc6a-124040783f1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbd5216c-577d-42c9-a471-a99a85090a20", "tag": "bad8026f-4849-4e27-85b3-69b75386ebbf"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:27.158556 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:07:27.158556 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:07:27.168240 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-146188c1-01b9-4372-9c74-b072fbd4cc33 req-dc5f7b38-8252-4751-bc6a-124040783f1b service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:27.168687 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-146188c1-01b9-4372-9c74-b072fbd4cc33 req-dc5f7b38-8252-4751-bc6a-124040783f1b service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:27.179991 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-146188c1-01b9-4372-9c74-b072fbd4cc33 req-dc5f7b38-8252-4751-bc6a-124040783f1b service nova] Creating event network-changed:bad8026f-4849-4e27-85b3-69b75386ebbf for instance dbd5216c-577d-42c9-a471-a99a85090a20 on hv-cinder-80304 Jul 30 16:07:27.185095 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-146188c1-01b9-4372-9c74-b072fbd4cc33 req-dc5f7b38-8252-4751-bc6a-124040783f1b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032304 Jul 30 16:07:27.185765 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 42/93] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:07:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:07:27.365996 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-62213eed-d7b9-4d19-8bbf-e0bea1e3466e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:27.367033 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-62213eed-d7b9-4d19-8bbf-e0bea1e3466e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:27.381724 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-62213eed-d7b9-4d19-8bbf-e0bea1e3466e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:27.382177 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-62213eed-d7b9-4d19-8bbf-e0bea1e3466e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:27.382957 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-62213eed-d7b9-4d19-8bbf-e0bea1e3466e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:27.383455 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-62213eed-d7b9-4d19-8bbf-e0bea1e3466e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:27.450846 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-42c153f9-c414-4cf9-a00d-1dccbf830f41 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:27.451605 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-42c153f9-c414-4cf9-a00d-1dccbf830f41 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:27.459303 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-42c153f9-c414-4cf9-a00d-1dccbf830f41 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:27.459762 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-42c153f9-c414-4cf9-a00d-1dccbf830f41 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:27.460561 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-42c153f9-c414-4cf9-a00d-1dccbf830f41 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:27.461001 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-42c153f9-c414-4cf9-a00d-1dccbf830f41 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:27.571095 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-62213eed-d7b9-4d19-8bbf-e0bea1e3466e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:27.579536 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-62213eed-d7b9-4d19-8bbf-e0bea1e3466e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1321 microversion: 2.1 time: 0.217291 Jul 30 16:07:27.580114 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 52/94] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:27 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:27.691467 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-42c153f9-c414-4cf9-a00d-1dccbf830f41 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:27.700396 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-42c153f9-c414-4cf9-a00d-1dccbf830f41 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:27.701906 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-42c153f9-c414-4cf9-a00d-1dccbf830f41 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:27.702992 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-42c153f9-c414-4cf9-a00d-1dccbf830f41 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.256299 Jul 30 16:07:27.703945 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 43/95] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:27 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:07:27.729403 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-324696aa-2daf-4080-8e01-70cda9b68434 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:27.730152 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-324696aa-2daf-4080-8e01-70cda9b68434 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:27.736341 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-324696aa-2daf-4080-8e01-70cda9b68434 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:27.736858 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-324696aa-2daf-4080-8e01-70cda9b68434 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:27.737628 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-324696aa-2daf-4080-8e01-70cda9b68434 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:27.738060 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-324696aa-2daf-4080-8e01-70cda9b68434 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:27.747081 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d5d07bdb-d2ea-4237-bf50-ac9947c1520b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:27.747745 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d5d07bdb-d2ea-4237-bf50-ac9947c1520b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:27.755107 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d5d07bdb-d2ea-4237-bf50-ac9947c1520b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:27.755504 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d5d07bdb-d2ea-4237-bf50-ac9947c1520b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:27.756291 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d5d07bdb-d2ea-4237-bf50-ac9947c1520b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:27.756728 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d5d07bdb-d2ea-4237-bf50-ac9947c1520b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:27.908386 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-324696aa-2daf-4080-8e01-70cda9b68434 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:27.917659 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-324696aa-2daf-4080-8e01-70cda9b68434 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.191830 Jul 30 16:07:27.918729 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 53/96] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:27 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:27.937120 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d5d07bdb-d2ea-4237-bf50-ac9947c1520b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:27.944708 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d5d07bdb-d2ea-4237-bf50-ac9947c1520b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.202430 Jul 30 16:07:27.954910 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 44/97] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:27 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:28.600290 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b866f166-97d2-4a81-a907-c0a82c7534ae tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:28.601578 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b866f166-97d2-4a81-a907-c0a82c7534ae tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:28.608912 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b866f166-97d2-4a81-a907-c0a82c7534ae tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:28.609775 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b866f166-97d2-4a81-a907-c0a82c7534ae tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:28.610853 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b866f166-97d2-4a81-a907-c0a82c7534ae tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:28.611541 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b866f166-97d2-4a81-a907-c0a82c7534ae tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:28.721042 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e69b30f2-24b3-4e3e-8a07-6bb810296f54 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:28.722182 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e69b30f2-24b3-4e3e-8a07-6bb810296f54 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:28.728775 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e69b30f2-24b3-4e3e-8a07-6bb810296f54 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:28.731184 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e69b30f2-24b3-4e3e-8a07-6bb810296f54 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:28.734292 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e69b30f2-24b3-4e3e-8a07-6bb810296f54 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:28.735480 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e69b30f2-24b3-4e3e-8a07-6bb810296f54 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:28.750765 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b866f166-97d2-4a81-a907-c0a82c7534ae tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:28.760085 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b866f166-97d2-4a81-a907-c0a82c7534ae tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1321 microversion: 2.1 time: 0.163869 Jul 30 16:07:28.762823 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 54/98] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:28 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:28.895263 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e69b30f2-24b3-4e3e-8a07-6bb810296f54 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:28.903960 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e69b30f2-24b3-4e3e-8a07-6bb810296f54 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:28.905476 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e69b30f2-24b3-4e3e-8a07-6bb810296f54 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:28.906810 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e69b30f2-24b3-4e3e-8a07-6bb810296f54 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.189418 Jul 30 16:07:28.907491 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 45/99] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:28 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:28.935575 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-4834ec95-6757-4116-8ca3-d27a0a141f26 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:28.936550 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-4834ec95-6757-4116-8ca3-d27a0a141f26 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:28.943845 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4834ec95-6757-4116-8ca3-d27a0a141f26 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:28.944154 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4834ec95-6757-4116-8ca3-d27a0a141f26 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:28.945147 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4834ec95-6757-4116-8ca3-d27a0a141f26 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:28.945686 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4834ec95-6757-4116-8ca3-d27a0a141f26 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:28.965436 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9678bcf0-ad23-494e-b48a-885ec62f047f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:28.965436 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9678bcf0-ad23-494e-b48a-885ec62f047f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:28.972053 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9678bcf0-ad23-494e-b48a-885ec62f047f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:28.972507 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9678bcf0-ad23-494e-b48a-885ec62f047f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:28.973277 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9678bcf0-ad23-494e-b48a-885ec62f047f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:28.973718 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9678bcf0-ad23-494e-b48a-885ec62f047f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:29.124497 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-4834ec95-6757-4116-8ca3-d27a0a141f26 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:29.135960 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-4834ec95-6757-4116-8ca3-d27a0a141f26 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.204647 Jul 30 16:07:29.136739 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 55/100] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:28 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:29.162563 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9678bcf0-ad23-494e-b48a-885ec62f047f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:29.164406 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9678bcf0-ad23-494e-b48a-885ec62f047f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.204502 Jul 30 16:07:29.164979 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 46/101] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:28 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:29.779623 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d5969fe0-6eee-4f0e-9160-37aaebfe4164 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:29.780268 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d5969fe0-6eee-4f0e-9160-37aaebfe4164 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:29.786821 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d5969fe0-6eee-4f0e-9160-37aaebfe4164 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:29.787317 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d5969fe0-6eee-4f0e-9160-37aaebfe4164 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:29.788089 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d5969fe0-6eee-4f0e-9160-37aaebfe4164 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:29.788530 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d5969fe0-6eee-4f0e-9160-37aaebfe4164 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:29.916381 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d5969fe0-6eee-4f0e-9160-37aaebfe4164 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:29.925993 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f77a26e4-85c0-4231-b8b8-c304d2267514 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:29.926609 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f77a26e4-85c0-4231-b8b8-c304d2267514 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:29.931386 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d5969fe0-6eee-4f0e-9160-37aaebfe4164 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1321 microversion: 2.1 time: 0.155466 Jul 30 16:07:29.931969 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 56/102] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:29 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:29.935091 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f77a26e4-85c0-4231-b8b8-c304d2267514 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:29.935874 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f77a26e4-85c0-4231-b8b8-c304d2267514 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:29.937284 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f77a26e4-85c0-4231-b8b8-c304d2267514 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:29.938102 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f77a26e4-85c0-4231-b8b8-c304d2267514 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:30.069456 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f77a26e4-85c0-4231-b8b8-c304d2267514 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:30.077202 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f77a26e4-85c0-4231-b8b8-c304d2267514 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:30.078752 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f77a26e4-85c0-4231-b8b8-c304d2267514 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:30.079853 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f77a26e4-85c0-4231-b8b8-c304d2267514 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.158870 Jul 30 16:07:30.080402 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 47/103] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:29 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:30.152600 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-879de814-a2af-4817-8ac4-d39668d05498 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:30.153212 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-879de814-a2af-4817-8ac4-d39668d05498 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:30.159216 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-879de814-a2af-4817-8ac4-d39668d05498 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:30.159666 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-879de814-a2af-4817-8ac4-d39668d05498 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:30.160469 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-879de814-a2af-4817-8ac4-d39668d05498 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:30.160851 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-879de814-a2af-4817-8ac4-d39668d05498 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:30.181434 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-507beef9-15cb-49b1-9285-7bd6dde58b28 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:30.182048 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-507beef9-15cb-49b1-9285-7bd6dde58b28 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:30.188479 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-507beef9-15cb-49b1-9285-7bd6dde58b28 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:30.188924 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-507beef9-15cb-49b1-9285-7bd6dde58b28 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:30.189701 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-507beef9-15cb-49b1-9285-7bd6dde58b28 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:30.190138 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-507beef9-15cb-49b1-9285-7bd6dde58b28 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:30.306992 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-879de814-a2af-4817-8ac4-d39668d05498 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:30.317283 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-879de814-a2af-4817-8ac4-d39668d05498 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.168246 Jul 30 16:07:30.317970 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 57/104] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:30 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:30.343792 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-507beef9-15cb-49b1-9285-7bd6dde58b28 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:30.351152 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-507beef9-15cb-49b1-9285-7bd6dde58b28 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.173605 Jul 30 16:07:30.352005 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 48/105] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:30 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:30.948029 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0250255a-ea7c-4b55-93f7-62f8447cb485 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:30.948650 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0250255a-ea7c-4b55-93f7-62f8447cb485 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:30.954868 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0250255a-ea7c-4b55-93f7-62f8447cb485 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:30.956331 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0250255a-ea7c-4b55-93f7-62f8447cb485 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:30.956739 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0250255a-ea7c-4b55-93f7-62f8447cb485 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:30.957217 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0250255a-ea7c-4b55-93f7-62f8447cb485 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:31.100533 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4f777690-b5fd-491c-b99b-aab6eed367b1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:31.101148 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4f777690-b5fd-491c-b99b-aab6eed367b1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:31.106867 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4f777690-b5fd-491c-b99b-aab6eed367b1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:31.107349 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4f777690-b5fd-491c-b99b-aab6eed367b1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:31.108115 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4f777690-b5fd-491c-b99b-aab6eed367b1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:31.108715 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4f777690-b5fd-491c-b99b-aab6eed367b1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:31.113434 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0250255a-ea7c-4b55-93f7-62f8447cb485 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:31.124010 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0250255a-ea7c-4b55-93f7-62f8447cb485 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1321 microversion: 2.1 time: 0.179536 Jul 30 16:07:31.125719 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 58/106] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:30 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:31.255282 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4f777690-b5fd-491c-b99b-aab6eed367b1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:31.266979 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4f777690-b5fd-491c-b99b-aab6eed367b1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:31.268804 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4f777690-b5fd-491c-b99b-aab6eed367b1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:31.270054 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4f777690-b5fd-491c-b99b-aab6eed367b1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.175035 Jul 30 16:07:31.270715 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 49/107] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:31 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:31.333933 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0b6cedb2-9f0d-48f9-a679-089c1e2a057c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:31.334572 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0b6cedb2-9f0d-48f9-a679-089c1e2a057c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:31.340400 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0b6cedb2-9f0d-48f9-a679-089c1e2a057c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:31.340850 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0b6cedb2-9f0d-48f9-a679-089c1e2a057c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:31.341621 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0b6cedb2-9f0d-48f9-a679-089c1e2a057c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:31.342058 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0b6cedb2-9f0d-48f9-a679-089c1e2a057c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:31.368661 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8641de77-78f0-449b-b225-73b72fe4fef2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:31.369503 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-8641de77-78f0-449b-b225-73b72fe4fef2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:31.380657 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8641de77-78f0-449b-b225-73b72fe4fef2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:31.381220 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8641de77-78f0-449b-b225-73b72fe4fef2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:31.382105 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8641de77-78f0-449b-b225-73b72fe4fef2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:31.382640 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8641de77-78f0-449b-b225-73b72fe4fef2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:31.487995 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0b6cedb2-9f0d-48f9-a679-089c1e2a057c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:31.495605 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0b6cedb2-9f0d-48f9-a679-089c1e2a057c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.165256 Jul 30 16:07:31.496478 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 59/108] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:31 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:31.526632 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-8641de77-78f0-449b-b225-73b72fe4fef2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:31.537805 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8641de77-78f0-449b-b225-73b72fe4fef2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.173168 Jul 30 16:07:31.544977 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 50/109] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:31 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:32.144431 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0ee98a06-1100-4c53-8d1b-bbf2e4d9ffd5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:32.145058 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0ee98a06-1100-4c53-8d1b-bbf2e4d9ffd5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:32.150507 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0ee98a06-1100-4c53-8d1b-bbf2e4d9ffd5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:32.150957 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0ee98a06-1100-4c53-8d1b-bbf2e4d9ffd5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:32.151772 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0ee98a06-1100-4c53-8d1b-bbf2e4d9ffd5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:32.152208 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0ee98a06-1100-4c53-8d1b-bbf2e4d9ffd5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:32.275269 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0ee98a06-1100-4c53-8d1b-bbf2e4d9ffd5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:32.282515 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0ee98a06-1100-4c53-8d1b-bbf2e4d9ffd5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1321 microversion: 2.1 time: 0.142843 Jul 30 16:07:32.283615 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 60/110] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:32 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1321 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:32.287819 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4d315bf2-9e25-4b36-8248-9f3c6a8514bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:32.288438 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4d315bf2-9e25-4b36-8248-9f3c6a8514bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:32.294401 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4d315bf2-9e25-4b36-8248-9f3c6a8514bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:32.295173 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4d315bf2-9e25-4b36-8248-9f3c6a8514bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:32.295684 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4d315bf2-9e25-4b36-8248-9f3c6a8514bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:32.296117 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4d315bf2-9e25-4b36-8248-9f3c6a8514bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:32.413373 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4d315bf2-9e25-4b36-8248-9f3c6a8514bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:32.423087 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4d315bf2-9e25-4b36-8248-9f3c6a8514bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:32.424675 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4d315bf2-9e25-4b36-8248-9f3c6a8514bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:32.425771 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4d315bf2-9e25-4b36-8248-9f3c6a8514bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.141711 Jul 30 16:07:32.426584 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 51/111] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:32 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:07:32.512507 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ec7bd81a-5a26-490d-8f86-e486d9463de6 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:32.513221 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ec7bd81a-5a26-490d-8f86-e486d9463de6 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:32.519221 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ec7bd81a-5a26-490d-8f86-e486d9463de6 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:32.519754 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ec7bd81a-5a26-490d-8f86-e486d9463de6 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:32.520623 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ec7bd81a-5a26-490d-8f86-e486d9463de6 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:32.521134 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ec7bd81a-5a26-490d-8f86-e486d9463de6 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:32.553936 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4c97c522-07fc-4f7b-8d0d-35e480ac7870 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:32.554843 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4c97c522-07fc-4f7b-8d0d-35e480ac7870 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:32.561225 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4c97c522-07fc-4f7b-8d0d-35e480ac7870 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:32.562008 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4c97c522-07fc-4f7b-8d0d-35e480ac7870 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:32.563226 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4c97c522-07fc-4f7b-8d0d-35e480ac7870 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:32.563855 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4c97c522-07fc-4f7b-8d0d-35e480ac7870 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:32.650447 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-ec7bd81a-5a26-490d-8f86-e486d9463de6 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:32.670148 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ec7bd81a-5a26-490d-8f86-e486d9463de6 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.161481 Jul 30 16:07:32.670978 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 61/112] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:32 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:32.708453 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4c97c522-07fc-4f7b-8d0d-35e480ac7870 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:32.715899 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4c97c522-07fc-4f7b-8d0d-35e480ac7870 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.165565 Jul 30 16:07:32.716458 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 52/113] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:32 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:32.816007 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-0a65e0e0-9606-4c2b-b8db-33b2d47d4297 req-b47fde8a-c709-4445-a806-06f81418c16f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26181d7-db01-409a-af4d-e60ceed08514", "name": "network-vif-plugged", "status": "completed", "tag": "2722991c-02f6-4d1b-a307-ec06cfcdb383"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:32.817584 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:07:32.817584 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:07:32.824416 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-0a65e0e0-9606-4c2b-b8db-33b2d47d4297 req-b47fde8a-c709-4445-a806-06f81418c16f service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:32.824860 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-0a65e0e0-9606-4c2b-b8db-33b2d47d4297 req-b47fde8a-c709-4445-a806-06f81418c16f service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:32.836266 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-0a65e0e0-9606-4c2b-b8db-33b2d47d4297 req-b47fde8a-c709-4445-a806-06f81418c16f service nova] Creating event network-vif-plugged:2722991c-02f6-4d1b-a307-ec06cfcdb383 for instance e26181d7-db01-409a-af4d-e60ceed08514 on hv-cinder-80304 Jul 30 16:07:32.841148 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-0a65e0e0-9606-4c2b-b8db-33b2d47d4297 req-b47fde8a-c709-4445-a806-06f81418c16f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081962 Jul 30 16:07:32.841723 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 62/114] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:07:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:07:33.298301 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c8040f3d-36d9-459e-b71a-7565cac7fa74 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:33.298912 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c8040f3d-36d9-459e-b71a-7565cac7fa74 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:33.304990 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c8040f3d-36d9-459e-b71a-7565cac7fa74 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:33.305778 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c8040f3d-36d9-459e-b71a-7565cac7fa74 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:33.306558 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c8040f3d-36d9-459e-b71a-7565cac7fa74 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:33.306997 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c8040f3d-36d9-459e-b71a-7565cac7fa74 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:33.427071 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c8040f3d-36d9-459e-b71a-7565cac7fa74 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:33.434315 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c8040f3d-36d9-459e-b71a-7565cac7fa74 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1321 microversion: 2.1 time: 0.139629 Jul 30 16:07:33.434873 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 53/115] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:33 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1321 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:33.443582 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e362aedc-84b9-4b3a-bb7f-bce2b294a71b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:33.444281 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e362aedc-84b9-4b3a-bb7f-bce2b294a71b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:33.450199 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e362aedc-84b9-4b3a-bb7f-bce2b294a71b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:33.450647 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e362aedc-84b9-4b3a-bb7f-bce2b294a71b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:33.451440 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e362aedc-84b9-4b3a-bb7f-bce2b294a71b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:33.451877 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e362aedc-84b9-4b3a-bb7f-bce2b294a71b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:33.579433 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e362aedc-84b9-4b3a-bb7f-bce2b294a71b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:33.587096 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e362aedc-84b9-4b3a-bb7f-bce2b294a71b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:33.588625 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e362aedc-84b9-4b3a-bb7f-bce2b294a71b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:33.589702 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e362aedc-84b9-4b3a-bb7f-bce2b294a71b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.150272 Jul 30 16:07:33.590259 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 63/116] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:33 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:33.687024 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b51c9853-086b-4dcf-8998-e04b046d6e1c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:33.687757 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b51c9853-086b-4dcf-8998-e04b046d6e1c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:33.693779 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b51c9853-086b-4dcf-8998-e04b046d6e1c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:33.694231 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b51c9853-086b-4dcf-8998-e04b046d6e1c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:33.695003 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b51c9853-086b-4dcf-8998-e04b046d6e1c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:33.695472 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b51c9853-086b-4dcf-8998-e04b046d6e1c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:33.732659 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a72c9b09-4be8-48d6-8b7d-ce3b9322279d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:33.733269 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a72c9b09-4be8-48d6-8b7d-ce3b9322279d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:33.739812 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a72c9b09-4be8-48d6-8b7d-ce3b9322279d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:33.740253 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a72c9b09-4be8-48d6-8b7d-ce3b9322279d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:33.741022 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a72c9b09-4be8-48d6-8b7d-ce3b9322279d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:33.741453 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a72c9b09-4be8-48d6-8b7d-ce3b9322279d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:33.816583 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b51c9853-086b-4dcf-8998-e04b046d6e1c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:33.823762 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b51c9853-086b-4dcf-8998-e04b046d6e1c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.140314 Jul 30 16:07:33.824323 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 54/117] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:33 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:33.866309 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-a72c9b09-4be8-48d6-8b7d-ce3b9322279d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:33.873389 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a72c9b09-4be8-48d6-8b7d-ce3b9322279d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.144383 Jul 30 16:07:33.873960 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 64/118] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:33 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:34.451373 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1599aa63-e0f8-4e3a-a527-b7274408643b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:34.451991 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1599aa63-e0f8-4e3a-a527-b7274408643b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:34.458045 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1599aa63-e0f8-4e3a-a527-b7274408643b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:34.458497 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1599aa63-e0f8-4e3a-a527-b7274408643b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:34.459291 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1599aa63-e0f8-4e3a-a527-b7274408643b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:34.459730 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1599aa63-e0f8-4e3a-a527-b7274408643b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:34.576094 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1599aa63-e0f8-4e3a-a527-b7274408643b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:34.583760 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1599aa63-e0f8-4e3a-a527-b7274408643b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1321 microversion: 2.1 time: 0.136086 Jul 30 16:07:34.584321 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 55/119] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:34 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1321 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:34.607189 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-adb37818-47e0-4c72-8bcf-1920ea6bca24 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:34.607799 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-adb37818-47e0-4c72-8bcf-1920ea6bca24 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:34.613623 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-adb37818-47e0-4c72-8bcf-1920ea6bca24 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:34.614068 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-adb37818-47e0-4c72-8bcf-1920ea6bca24 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:34.614830 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-adb37818-47e0-4c72-8bcf-1920ea6bca24 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:34.615295 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-adb37818-47e0-4c72-8bcf-1920ea6bca24 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:34.747813 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-adb37818-47e0-4c72-8bcf-1920ea6bca24 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:34.756439 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-adb37818-47e0-4c72-8bcf-1920ea6bca24 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:34.757952 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-adb37818-47e0-4c72-8bcf-1920ea6bca24 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:34.759095 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-adb37818-47e0-4c72-8bcf-1920ea6bca24 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.155607 Jul 30 16:07:34.769609 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 65/120] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:34 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:34.841898 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4679a6ab-2391-41ff-9ebb-9cd56744be2d tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:34.843418 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4679a6ab-2391-41ff-9ebb-9cd56744be2d tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:34.851437 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4679a6ab-2391-41ff-9ebb-9cd56744be2d tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:34.852223 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4679a6ab-2391-41ff-9ebb-9cd56744be2d tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:34.853811 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4679a6ab-2391-41ff-9ebb-9cd56744be2d tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:34.854614 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4679a6ab-2391-41ff-9ebb-9cd56744be2d tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:34.890778 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-fe413f6e-c47c-4dd8-84fc-1b7950523f9a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:34.891427 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-fe413f6e-c47c-4dd8-84fc-1b7950523f9a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:34.900370 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fe413f6e-c47c-4dd8-84fc-1b7950523f9a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:34.900821 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fe413f6e-c47c-4dd8-84fc-1b7950523f9a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:34.901601 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fe413f6e-c47c-4dd8-84fc-1b7950523f9a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:34.902033 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fe413f6e-c47c-4dd8-84fc-1b7950523f9a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:35.097085 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-fe413f6e-c47c-4dd8-84fc-1b7950523f9a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:35.108610 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-fe413f6e-c47c-4dd8-84fc-1b7950523f9a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.221737 Jul 30 16:07:35.115979 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 66/121] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:34 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:35.194439 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4679a6ab-2391-41ff-9ebb-9cd56744be2d tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:35.208964 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4679a6ab-2391-41ff-9ebb-9cd56744be2d tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.368901 Jul 30 16:07:35.208964 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 56/122] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:34 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:35.600592 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d0725c73-6641-46de-bd2c-31aa129e9ced tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:35.601427 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d0725c73-6641-46de-bd2c-31aa129e9ced tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:35.611688 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d0725c73-6641-46de-bd2c-31aa129e9ced tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:35.612777 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d0725c73-6641-46de-bd2c-31aa129e9ced tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:35.613723 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d0725c73-6641-46de-bd2c-31aa129e9ced tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:35.614324 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d0725c73-6641-46de-bd2c-31aa129e9ced tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:35.781939 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d0725c73-6641-46de-bd2c-31aa129e9ced tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:35.782452 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0f3a9dea-9535-4c34-951d-5cea39c1e019 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:35.783889 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0f3a9dea-9535-4c34-951d-5cea39c1e019 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:35.796543 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0f3a9dea-9535-4c34-951d-5cea39c1e019 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:35.796543 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0f3a9dea-9535-4c34-951d-5cea39c1e019 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:35.796543 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0f3a9dea-9535-4c34-951d-5cea39c1e019 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:35.796543 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0f3a9dea-9535-4c34-951d-5cea39c1e019 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:35.799789 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d0725c73-6641-46de-bd2c-31aa129e9ced tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1321 microversion: 2.1 time: 0.202788 Jul 30 16:07:35.801412 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 67/123] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:35 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:35.950343 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0f3a9dea-9535-4c34-951d-5cea39c1e019 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:35.959736 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0f3a9dea-9535-4c34-951d-5cea39c1e019 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:35.961508 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0f3a9dea-9535-4c34-951d-5cea39c1e019 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:35.962597 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0f3a9dea-9535-4c34-951d-5cea39c1e019 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.188103 Jul 30 16:07:35.963336 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 57/124] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:35 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:36.126911 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1684e57e-bf5f-4168-ba86-4e50faded94f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:36.127907 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1684e57e-bf5f-4168-ba86-4e50faded94f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:36.133963 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1684e57e-bf5f-4168-ba86-4e50faded94f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:36.134405 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1684e57e-bf5f-4168-ba86-4e50faded94f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:36.135187 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1684e57e-bf5f-4168-ba86-4e50faded94f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:36.135611 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1684e57e-bf5f-4168-ba86-4e50faded94f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:36.227103 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-76432ac1-1953-4b37-a005-de2c12165e7c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:36.227749 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-76432ac1-1953-4b37-a005-de2c12165e7c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:36.233501 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-76432ac1-1953-4b37-a005-de2c12165e7c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:36.233949 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-76432ac1-1953-4b37-a005-de2c12165e7c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:36.234789 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-76432ac1-1953-4b37-a005-de2c12165e7c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:36.235886 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-76432ac1-1953-4b37-a005-de2c12165e7c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:36.273428 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1684e57e-bf5f-4168-ba86-4e50faded94f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:36.282476 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1684e57e-bf5f-4168-ba86-4e50faded94f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.160258 Jul 30 16:07:36.283554 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 68/125] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:36 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:36.380442 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-76432ac1-1953-4b37-a005-de2c12165e7c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:36.389531 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-76432ac1-1953-4b37-a005-de2c12165e7c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.166322 Jul 30 16:07:36.390099 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 58/126] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:36 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:36.475398 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-df17242a-1f7b-4b02-a301-274a067bafdc req-f41c7c7c-887e-4600-83b7-f96ad4d8dd3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b40b08-b26d-408a-a189-89e1abad5e88", "name": "network-vif-plugged", "status": "completed", "tag": "b7c2f2ac-ee9c-4c0b-9449-d350635bd2d0"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:36.477137 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:07:36.477137 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:07:36.485585 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-df17242a-1f7b-4b02-a301-274a067bafdc req-f41c7c7c-887e-4600-83b7-f96ad4d8dd3c service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:36.486031 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-df17242a-1f7b-4b02-a301-274a067bafdc req-f41c7c7c-887e-4600-83b7-f96ad4d8dd3c service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:36.498139 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-df17242a-1f7b-4b02-a301-274a067bafdc req-f41c7c7c-887e-4600-83b7-f96ad4d8dd3c service nova] Creating event network-vif-plugged:b7c2f2ac-ee9c-4c0b-9449-d350635bd2d0 for instance 06b40b08-b26d-408a-a189-89e1abad5e88 on hv-cinder-80304 Jul 30 16:07:36.504225 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-df17242a-1f7b-4b02-a301-274a067bafdc req-f41c7c7c-887e-4600-83b7-f96ad4d8dd3c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032389 Jul 30 16:07:36.505135 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 69/127] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:07:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:07:36.826531 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4922612c-4437-415e-99b2-11f20a0e238c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:36.827156 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4922612c-4437-415e-99b2-11f20a0e238c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:36.833200 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4922612c-4437-415e-99b2-11f20a0e238c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:36.833749 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4922612c-4437-415e-99b2-11f20a0e238c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:36.834597 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4922612c-4437-415e-99b2-11f20a0e238c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:36.835263 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4922612c-4437-415e-99b2-11f20a0e238c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:36.964543 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4922612c-4437-415e-99b2-11f20a0e238c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:36.972929 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4922612c-4437-415e-99b2-11f20a0e238c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1321 microversion: 2.1 time: 0.150127 Jul 30 16:07:36.974171 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 59/128] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:36 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:36.994075 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c335509a-9efc-4973-8d6d-6ce8df03bbb8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:36.994767 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c335509a-9efc-4973-8d6d-6ce8df03bbb8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:37.001044 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c335509a-9efc-4973-8d6d-6ce8df03bbb8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:37.001498 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c335509a-9efc-4973-8d6d-6ce8df03bbb8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:37.002251 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c335509a-9efc-4973-8d6d-6ce8df03bbb8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:37.002675 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c335509a-9efc-4973-8d6d-6ce8df03bbb8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:37.124277 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c335509a-9efc-4973-8d6d-6ce8df03bbb8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:37.132444 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c335509a-9efc-4973-8d6d-6ce8df03bbb8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:37.133954 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c335509a-9efc-4973-8d6d-6ce8df03bbb8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:37.135030 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c335509a-9efc-4973-8d6d-6ce8df03bbb8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.145083 Jul 30 16:07:37.135649 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 70/129] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:36 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:37.298513 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c6df0096-8716-4be0-b2f9-eb5b6ad6d763 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:37.299111 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c6df0096-8716-4be0-b2f9-eb5b6ad6d763 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:37.304774 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c6df0096-8716-4be0-b2f9-eb5b6ad6d763 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:37.305217 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c6df0096-8716-4be0-b2f9-eb5b6ad6d763 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:37.305970 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c6df0096-8716-4be0-b2f9-eb5b6ad6d763 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:37.306397 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c6df0096-8716-4be0-b2f9-eb5b6ad6d763 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:37.408025 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a7b5f671-f8d3-4b58-bf93-6f2d6ade99d3 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:37.408630 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a7b5f671-f8d3-4b58-bf93-6f2d6ade99d3 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:37.414818 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a7b5f671-f8d3-4b58-bf93-6f2d6ade99d3 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:37.415302 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a7b5f671-f8d3-4b58-bf93-6f2d6ade99d3 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:37.416254 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a7b5f671-f8d3-4b58-bf93-6f2d6ade99d3 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:37.416692 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a7b5f671-f8d3-4b58-bf93-6f2d6ade99d3 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:37.433080 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c6df0096-8716-4be0-b2f9-eb5b6ad6d763 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:37.442478 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c6df0096-8716-4be0-b2f9-eb5b6ad6d763 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.147565 Jul 30 16:07:37.454868 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 60/130] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:37 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:37.545658 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-a7b5f671-f8d3-4b58-bf93-6f2d6ade99d3 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:37.553926 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a7b5f671-f8d3-4b58-bf93-6f2d6ade99d3 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1314 microversion: 2.1 time: 0.150795 Jul 30 16:07:37.554962 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 71/131] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:37 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:37.992052 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-bd965d11-ebe5-403f-826a-869c0602df4d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:37.992711 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-bd965d11-ebe5-403f-826a-869c0602df4d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:37.998590 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bd965d11-ebe5-403f-826a-869c0602df4d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:37.999046 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bd965d11-ebe5-403f-826a-869c0602df4d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:37.999856 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bd965d11-ebe5-403f-826a-869c0602df4d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:38.000527 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bd965d11-ebe5-403f-826a-869c0602df4d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:38.133231 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-bd965d11-ebe5-403f-826a-869c0602df4d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:38.141020 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-bd965d11-ebe5-403f-826a-869c0602df4d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1321 microversion: 2.1 time: 0.154207 Jul 30 16:07:38.141686 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 61/132] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:37 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:38.155576 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-4b074dea-6e3c-4c0a-92a6-9eb8f3607c6e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:38.156675 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-4b074dea-6e3c-4c0a-92a6-9eb8f3607c6e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:38.163062 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4b074dea-6e3c-4c0a-92a6-9eb8f3607c6e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:38.163647 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4b074dea-6e3c-4c0a-92a6-9eb8f3607c6e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:38.164446 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4b074dea-6e3c-4c0a-92a6-9eb8f3607c6e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:38.164992 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4b074dea-6e3c-4c0a-92a6-9eb8f3607c6e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:38.305360 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-4b074dea-6e3c-4c0a-92a6-9eb8f3607c6e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:38.314964 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-4b074dea-6e3c-4c0a-92a6-9eb8f3607c6e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:38.316568 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-4b074dea-6e3c-4c0a-92a6-9eb8f3607c6e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:38.317990 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-4b074dea-6e3c-4c0a-92a6-9eb8f3607c6e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.166223 Jul 30 16:07:38.318815 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 72/133] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:38 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:38.462172 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1a7201b6-a0f8-43ca-a4ab-0f2433507ce7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:38.462871 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1a7201b6-a0f8-43ca-a4ab-0f2433507ce7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:38.469217 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1a7201b6-a0f8-43ca-a4ab-0f2433507ce7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:38.469825 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1a7201b6-a0f8-43ca-a4ab-0f2433507ce7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:38.470679 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1a7201b6-a0f8-43ca-a4ab-0f2433507ce7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:38.471215 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1a7201b6-a0f8-43ca-a4ab-0f2433507ce7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:38.572325 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f25026f4-96f1-4fcc-88f9-f47eef3b1b8b tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:38.573291 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f25026f4-96f1-4fcc-88f9-f47eef3b1b8b tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:38.590092 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f25026f4-96f1-4fcc-88f9-f47eef3b1b8b tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:38.595157 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f25026f4-96f1-4fcc-88f9-f47eef3b1b8b tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:38.597018 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f25026f4-96f1-4fcc-88f9-f47eef3b1b8b tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:38.598840 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f25026f4-96f1-4fcc-88f9-f47eef3b1b8b tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:38.621450 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1a7201b6-a0f8-43ca-a4ab-0f2433507ce7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:38.630266 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1a7201b6-a0f8-43ca-a4ab-0f2433507ce7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.171499 Jul 30 16:07:38.644727 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 62/134] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:38 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:38.779337 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f25026f4-96f1-4fcc-88f9-f47eef3b1b8b tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:38.787380 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f25026f4-96f1-4fcc-88f9-f47eef3b1b8b tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1500 microversion: 2.1 time: 0.219081 Jul 30 16:07:38.787957 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 73/135] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:38 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1500 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:39.159908 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2b7ea695-8b2a-48bf-8f53-09e6dc1070f6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:39.161312 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-2b7ea695-8b2a-48bf-8f53-09e6dc1070f6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:39.170204 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2b7ea695-8b2a-48bf-8f53-09e6dc1070f6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:39.170760 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2b7ea695-8b2a-48bf-8f53-09e6dc1070f6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:39.174252 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2b7ea695-8b2a-48bf-8f53-09e6dc1070f6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:39.174252 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2b7ea695-8b2a-48bf-8f53-09e6dc1070f6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:39.329627 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-2b7ea695-8b2a-48bf-8f53-09e6dc1070f6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:39.337835 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2b7ea695-8b2a-48bf-8f53-09e6dc1070f6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1516 microversion: 2.1 time: 0.183079 Jul 30 16:07:39.338582 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 63/136] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:39 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:39.342834 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9c128272-b970-452e-9d8d-a58ac14dbd7a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:39.343739 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9c128272-b970-452e-9d8d-a58ac14dbd7a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:39.351304 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9c128272-b970-452e-9d8d-a58ac14dbd7a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:39.351761 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9c128272-b970-452e-9d8d-a58ac14dbd7a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:39.352846 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9c128272-b970-452e-9d8d-a58ac14dbd7a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:39.353311 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9c128272-b970-452e-9d8d-a58ac14dbd7a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:39.355196 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e4a5685e-ac98-4fe8-b9d9-ef9dbc2d4c3d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:39.356195 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e4a5685e-ac98-4fe8-b9d9-ef9dbc2d4c3d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:39.362802 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e4a5685e-ac98-4fe8-b9d9-ef9dbc2d4c3d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:39.363285 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e4a5685e-ac98-4fe8-b9d9-ef9dbc2d4c3d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:39.364061 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e4a5685e-ac98-4fe8-b9d9-ef9dbc2d4c3d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:39.364786 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e4a5685e-ac98-4fe8-b9d9-ef9dbc2d4c3d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:39.433711 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.objects.instance [None req-e4a5685e-ac98-4fe8-b9d9-ef9dbc2d4c3d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lazy-loading 'flavor' on Instance uuid 06b40b08-b26d-408a-a189-89e1abad5e88 {{(pid=107453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:07:39.495066 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9c128272-b970-452e-9d8d-a58ac14dbd7a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:39.504867 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9c128272-b970-452e-9d8d-a58ac14dbd7a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:39.506529 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9c128272-b970-452e-9d8d-a58ac14dbd7a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:39.507658 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9c128272-b970-452e-9d8d-a58ac14dbd7a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.169523 Jul 30 16:07:39.508209 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 74/137] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:39 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:07:39.558671 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e4a5685e-ac98-4fe8-b9d9-ef9dbc2d4c3d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "POST /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88/action" status: 200 len: 32 microversion: 2.1 time: 0.207378 Jul 30 16:07:39.559702 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 64/138] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:07:39 2021] POST /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88/action => generated 32 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:07:39.575909 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-61841dc5-cb93-4ceb-a395-9149d32b0d2f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:39.576563 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-61841dc5-cb93-4ceb-a395-9149d32b0d2f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:39.583661 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61841dc5-cb93-4ceb-a395-9149d32b0d2f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:39.584915 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61841dc5-cb93-4ceb-a395-9149d32b0d2f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:39.585696 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61841dc5-cb93-4ceb-a395-9149d32b0d2f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:39.586133 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61841dc5-cb93-4ceb-a395-9149d32b0d2f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:39.666104 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0922502b-d40c-4e00-96e8-ba179ba7cf76 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:39.666953 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0922502b-d40c-4e00-96e8-ba179ba7cf76 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:39.673882 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0922502b-d40c-4e00-96e8-ba179ba7cf76 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:39.674339 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0922502b-d40c-4e00-96e8-ba179ba7cf76 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:39.675110 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0922502b-d40c-4e00-96e8-ba179ba7cf76 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:39.675831 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0922502b-d40c-4e00-96e8-ba179ba7cf76 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:39.723666 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-61841dc5-cb93-4ceb-a395-9149d32b0d2f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:39.731496 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-61841dc5-cb93-4ceb-a395-9149d32b0d2f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.166020 Jul 30 16:07:39.732054 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 75/139] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:39 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:39.914453 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0922502b-d40c-4e00-96e8-ba179ba7cf76 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:39.921660 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0922502b-d40c-4e00-96e8-ba179ba7cf76 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.260412 Jul 30 16:07:39.923054 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 65/140] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:39 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:40.218848 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3ca8df3a-7a39-46b1-9bac-13299f33d5d9 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7eee5b9-ad8e-412f-8018-e76f69de1a5f"}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:40.220031 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3ca8df3a-7a39-46b1-9bac-13299f33d5d9 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:40.225782 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3ca8df3a-7a39-46b1-9bac-13299f33d5d9 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:40.226299 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3ca8df3a-7a39-46b1-9bac-13299f33d5d9 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:40.227078 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3ca8df3a-7a39-46b1-9bac-13299f33d5d9 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:40.227544 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3ca8df3a-7a39-46b1-9bac-13299f33d5d9 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:40.526997 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-bf75b9db-15d1-49e7-82e6-e65ac10769e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:40.527632 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-bf75b9db-15d1-49e7-82e6-e65ac10769e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:40.535114 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bf75b9db-15d1-49e7-82e6-e65ac10769e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:40.535811 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bf75b9db-15d1-49e7-82e6-e65ac10769e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:40.536655 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bf75b9db-15d1-49e7-82e6-e65ac10769e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:40.537112 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bf75b9db-15d1-49e7-82e6-e65ac10769e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:40.654686 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3ca8df3a-7a39-46b1-9bac-13299f33d5d9 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "POST /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439325 Jul 30 16:07:40.660602 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 76/141] 10.222.0.37 () {60 vars in 1323 bytes} [Fri Jul 30 16:07:40 2021] POST /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514/os-volume_attachments => generated 194 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:07:40.713535 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-bf75b9db-15d1-49e7-82e6-e65ac10769e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:40.726701 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-bf75b9db-15d1-49e7-82e6-e65ac10769e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:40.728317 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-bf75b9db-15d1-49e7-82e6-e65ac10769e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:40.729508 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-bf75b9db-15d1-49e7-82e6-e65ac10769e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.206077 Jul 30 16:07:40.740245 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 66/142] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:40 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:40.753415 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9e6dd444-9780-4804-8976-dee10fcc2f1c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:40.754322 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9e6dd444-9780-4804-8976-dee10fcc2f1c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:40.760814 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9e6dd444-9780-4804-8976-dee10fcc2f1c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:40.761350 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9e6dd444-9780-4804-8976-dee10fcc2f1c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:40.762483 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9e6dd444-9780-4804-8976-dee10fcc2f1c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:40.762993 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9e6dd444-9780-4804-8976-dee10fcc2f1c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:40.943180 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1725bfa9-aa76-45e6-a4e1-e7a885ad36de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:40.943180 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1725bfa9-aa76-45e6-a4e1-e7a885ad36de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:40.943575 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9e6dd444-9780-4804-8976-dee10fcc2f1c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:40.949174 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1725bfa9-aa76-45e6-a4e1-e7a885ad36de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:40.949650 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1725bfa9-aa76-45e6-a4e1-e7a885ad36de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:40.950631 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1725bfa9-aa76-45e6-a4e1-e7a885ad36de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:40.951050 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1725bfa9-aa76-45e6-a4e1-e7a885ad36de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:40.952527 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9e6dd444-9780-4804-8976-dee10fcc2f1c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.203899 Jul 30 16:07:40.954235 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 77/143] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:40 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:41.084118 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1725bfa9-aa76-45e6-a4e1-e7a885ad36de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:41.091273 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1725bfa9-aa76-45e6-a4e1-e7a885ad36de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.155293 Jul 30 16:07:41.091858 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 67/144] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:40 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:41.748750 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b5cd280c-2824-4f56-9e0d-7290857072f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:41.749359 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b5cd280c-2824-4f56-9e0d-7290857072f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:41.756779 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b5cd280c-2824-4f56-9e0d-7290857072f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:41.757267 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b5cd280c-2824-4f56-9e0d-7290857072f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:41.757990 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b5cd280c-2824-4f56-9e0d-7290857072f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:41.758423 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b5cd280c-2824-4f56-9e0d-7290857072f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:41.892560 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b5cd280c-2824-4f56-9e0d-7290857072f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:41.900539 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b5cd280c-2824-4f56-9e0d-7290857072f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:41.902043 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b5cd280c-2824-4f56-9e0d-7290857072f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:41.903112 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b5cd280c-2824-4f56-9e0d-7290857072f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.158023 Jul 30 16:07:41.903730 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 78/145] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:41 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:41.970681 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ba15cb77-4217-4e9c-b2b9-03cb6a40a9eb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:41.972054 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ba15cb77-4217-4e9c-b2b9-03cb6a40a9eb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:41.980742 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ba15cb77-4217-4e9c-b2b9-03cb6a40a9eb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:41.981200 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ba15cb77-4217-4e9c-b2b9-03cb6a40a9eb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:41.982010 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ba15cb77-4217-4e9c-b2b9-03cb6a40a9eb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:41.982633 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ba15cb77-4217-4e9c-b2b9-03cb6a40a9eb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:42.108186 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-5d00a929-7542-4cfe-884e-b5b9edd584be tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:42.108799 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-5d00a929-7542-4cfe-884e-b5b9edd584be tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:42.114839 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5d00a929-7542-4cfe-884e-b5b9edd584be tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:42.115367 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5d00a929-7542-4cfe-884e-b5b9edd584be tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:42.116156 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5d00a929-7542-4cfe-884e-b5b9edd584be tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:42.116639 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5d00a929-7542-4cfe-884e-b5b9edd584be tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:42.139213 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ba15cb77-4217-4e9c-b2b9-03cb6a40a9eb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:42.147790 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ba15cb77-4217-4e9c-b2b9-03cb6a40a9eb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.181530 Jul 30 16:07:42.148369 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 68/146] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:41 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:42.257396 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-5d00a929-7542-4cfe-884e-b5b9edd584be tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:42.265958 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-5d00a929-7542-4cfe-884e-b5b9edd584be tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.160693 Jul 30 16:07:42.266802 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 79/147] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:42 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:42.921424 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2c696f83-3ea7-4b2e-8085-459da6bf139e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:42.922676 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-2c696f83-3ea7-4b2e-8085-459da6bf139e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:42.928523 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2c696f83-3ea7-4b2e-8085-459da6bf139e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:42.928961 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2c696f83-3ea7-4b2e-8085-459da6bf139e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:42.929717 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2c696f83-3ea7-4b2e-8085-459da6bf139e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:42.930141 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2c696f83-3ea7-4b2e-8085-459da6bf139e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:43.070306 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-2c696f83-3ea7-4b2e-8085-459da6bf139e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:43.078428 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-2c696f83-3ea7-4b2e-8085-459da6bf139e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:43.081301 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-2c696f83-3ea7-4b2e-8085-459da6bf139e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:43.082401 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2c696f83-3ea7-4b2e-8085-459da6bf139e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.164588 Jul 30 16:07:43.083227 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 69/148] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:42 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:43.164841 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-74b6195c-e872-4ca2-9ab9-b4f08334b046 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:43.165449 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-74b6195c-e872-4ca2-9ab9-b4f08334b046 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:43.171406 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-74b6195c-e872-4ca2-9ab9-b4f08334b046 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:43.172502 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-74b6195c-e872-4ca2-9ab9-b4f08334b046 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:43.173315 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-74b6195c-e872-4ca2-9ab9-b4f08334b046 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:43.173755 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-74b6195c-e872-4ca2-9ab9-b4f08334b046 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:43.282370 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a706b327-63eb-4d03-a820-e3ea2174f67f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:43.284082 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a706b327-63eb-4d03-a820-e3ea2174f67f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:43.301414 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a706b327-63eb-4d03-a820-e3ea2174f67f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:43.301967 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a706b327-63eb-4d03-a820-e3ea2174f67f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:43.302978 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a706b327-63eb-4d03-a820-e3ea2174f67f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:43.303784 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a706b327-63eb-4d03-a820-e3ea2174f67f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:43.316308 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-74b6195c-e872-4ca2-9ab9-b4f08334b046 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:43.332743 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-74b6195c-e872-4ca2-9ab9-b4f08334b046 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.171371 Jul 30 16:07:43.333325 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 80/149] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:43 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:43.446173 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a706b327-63eb-4d03-a820-e3ea2174f67f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:43.453427 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a706b327-63eb-4d03-a820-e3ea2174f67f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.175591 Jul 30 16:07:43.454071 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 70/150] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:43 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:44.100349 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6dae3b68-f8cc-4d3e-9d08-4aaab160602b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:44.100958 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6dae3b68-f8cc-4d3e-9d08-4aaab160602b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:44.107418 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6dae3b68-f8cc-4d3e-9d08-4aaab160602b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:44.107864 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6dae3b68-f8cc-4d3e-9d08-4aaab160602b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:44.108625 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6dae3b68-f8cc-4d3e-9d08-4aaab160602b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:44.109080 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6dae3b68-f8cc-4d3e-9d08-4aaab160602b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:44.229051 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6dae3b68-f8cc-4d3e-9d08-4aaab160602b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:44.237347 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6dae3b68-f8cc-4d3e-9d08-4aaab160602b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:44.238836 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6dae3b68-f8cc-4d3e-9d08-4aaab160602b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:44.239928 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6dae3b68-f8cc-4d3e-9d08-4aaab160602b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.143621 Jul 30 16:07:44.240477 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 81/151] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:44 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:44.356172 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-cc7487d3-9b1e-44d2-ae86-9f37e152fa5f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:44.356870 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-cc7487d3-9b1e-44d2-ae86-9f37e152fa5f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:44.363416 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cc7487d3-9b1e-44d2-ae86-9f37e152fa5f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:44.363866 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cc7487d3-9b1e-44d2-ae86-9f37e152fa5f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:44.364635 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cc7487d3-9b1e-44d2-ae86-9f37e152fa5f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:44.365070 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cc7487d3-9b1e-44d2-ae86-9f37e152fa5f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:44.469598 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b8eadc07-ac7c-485a-aa49-d7dfe80297a8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:44.470228 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b8eadc07-ac7c-485a-aa49-d7dfe80297a8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:44.475986 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b8eadc07-ac7c-485a-aa49-d7dfe80297a8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:44.476632 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b8eadc07-ac7c-485a-aa49-d7dfe80297a8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:44.477406 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b8eadc07-ac7c-485a-aa49-d7dfe80297a8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:44.477840 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b8eadc07-ac7c-485a-aa49-d7dfe80297a8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:44.482420 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-cc7487d3-9b1e-44d2-ae86-9f37e152fa5f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:44.490164 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-cc7487d3-9b1e-44d2-ae86-9f37e152fa5f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.137602 Jul 30 16:07:44.490730 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 71/152] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:44 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:44.599299 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b8eadc07-ac7c-485a-aa49-d7dfe80297a8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:44.606724 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b8eadc07-ac7c-485a-aa49-d7dfe80297a8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.140813 Jul 30 16:07:44.607444 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 82/153] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:44 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:45.257680 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ed0f3620-c458-4aee-a1a7-28aa52f3afd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:45.258336 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ed0f3620-c458-4aee-a1a7-28aa52f3afd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:45.264755 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ed0f3620-c458-4aee-a1a7-28aa52f3afd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:45.265202 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ed0f3620-c458-4aee-a1a7-28aa52f3afd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:45.266567 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ed0f3620-c458-4aee-a1a7-28aa52f3afd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:45.267000 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ed0f3620-c458-4aee-a1a7-28aa52f3afd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:45.392536 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ed0f3620-c458-4aee-a1a7-28aa52f3afd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:45.400249 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ed0f3620-c458-4aee-a1a7-28aa52f3afd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:45.401746 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ed0f3620-c458-4aee-a1a7-28aa52f3afd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:45.402806 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ed0f3620-c458-4aee-a1a7-28aa52f3afd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.148979 Jul 30 16:07:45.403378 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 72/154] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:45 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:45.506289 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-36a65c93-8086-4aab-9b53-b9aefe12c20d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:45.506907 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-36a65c93-8086-4aab-9b53-b9aefe12c20d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:45.512896 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-36a65c93-8086-4aab-9b53-b9aefe12c20d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:45.513340 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-36a65c93-8086-4aab-9b53-b9aefe12c20d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:45.514096 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-36a65c93-8086-4aab-9b53-b9aefe12c20d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:45.514530 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-36a65c93-8086-4aab-9b53-b9aefe12c20d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:45.623569 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ca663d76-01b0-48a2-b776-487052818e34 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:45.625509 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ca663d76-01b0-48a2-b776-487052818e34 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:45.635254 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ca663d76-01b0-48a2-b776-487052818e34 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:45.635982 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ca663d76-01b0-48a2-b776-487052818e34 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:45.637086 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ca663d76-01b0-48a2-b776-487052818e34 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:45.637920 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ca663d76-01b0-48a2-b776-487052818e34 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:45.648270 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-36a65c93-8086-4aab-9b53-b9aefe12c20d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:45.655943 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-36a65c93-8086-4aab-9b53-b9aefe12c20d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.153152 Jul 30 16:07:45.656726 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 83/155] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:45 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:45.771439 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ca663d76-01b0-48a2-b776-487052818e34 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:45.778772 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ca663d76-01b0-48a2-b776-487052818e34 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.158862 Jul 30 16:07:45.779388 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 73/156] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:45 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:46.423638 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-22c6a15a-f340-44c2-b9d4-92c3136a7401 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:46.424691 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-22c6a15a-f340-44c2-b9d4-92c3136a7401 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:46.433061 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-22c6a15a-f340-44c2-b9d4-92c3136a7401 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:46.433793 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-22c6a15a-f340-44c2-b9d4-92c3136a7401 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:46.435003 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-22c6a15a-f340-44c2-b9d4-92c3136a7401 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:46.435638 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-22c6a15a-f340-44c2-b9d4-92c3136a7401 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:46.541489 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-2fd6957b-2653-4769-98e0-03a9c0384803 req-4807f701-6d17-4bda-9320-6fbaf5771c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb", "name": "network-vif-plugged", "status": "completed", "tag": "9138d528-69f5-4703-ba07-6f85b67dc617"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:46.543168 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:07:46.543168 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:07:46.557544 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-2fd6957b-2653-4769-98e0-03a9c0384803 req-4807f701-6d17-4bda-9320-6fbaf5771c38 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:46.558113 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-2fd6957b-2653-4769-98e0-03a9c0384803 req-4807f701-6d17-4bda-9320-6fbaf5771c38 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:46.572418 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-2fd6957b-2653-4769-98e0-03a9c0384803 req-4807f701-6d17-4bda-9320-6fbaf5771c38 service nova] Creating event network-vif-plugged:9138d528-69f5-4703-ba07-6f85b67dc617 for instance ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb on hv-cinder-80304 Jul 30 16:07:46.579155 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-2fd6957b-2653-4769-98e0-03a9c0384803 req-4807f701-6d17-4bda-9320-6fbaf5771c38 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040876 Jul 30 16:07:46.580081 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 74/157] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:07:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:07:46.614377 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-22c6a15a-f340-44c2-b9d4-92c3136a7401 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:46.624462 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-22c6a15a-f340-44c2-b9d4-92c3136a7401 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:46.626379 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-22c6a15a-f340-44c2-b9d4-92c3136a7401 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:46.627754 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-22c6a15a-f340-44c2-b9d4-92c3136a7401 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.209963 Jul 30 16:07:46.628937 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 84/158] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:46 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:46.674438 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-01f34b82-3460-4628-8e4d-cae2d1da8026 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:46.675158 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-01f34b82-3460-4628-8e4d-cae2d1da8026 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:46.685389 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-01f34b82-3460-4628-8e4d-cae2d1da8026 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:46.685878 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-01f34b82-3460-4628-8e4d-cae2d1da8026 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:46.690511 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-01f34b82-3460-4628-8e4d-cae2d1da8026 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:46.690983 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-01f34b82-3460-4628-8e4d-cae2d1da8026 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:46.800086 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-eede4832-d13e-47b1-8b2e-32cd1d0b7f03 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:46.800698 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-eede4832-d13e-47b1-8b2e-32cd1d0b7f03 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:46.809093 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-eede4832-d13e-47b1-8b2e-32cd1d0b7f03 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:46.809552 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-eede4832-d13e-47b1-8b2e-32cd1d0b7f03 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:46.810332 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-eede4832-d13e-47b1-8b2e-32cd1d0b7f03 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:46.810768 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-eede4832-d13e-47b1-8b2e-32cd1d0b7f03 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:46.869422 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-01f34b82-3460-4628-8e4d-cae2d1da8026 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:46.877845 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-01f34b82-3460-4628-8e4d-cae2d1da8026 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.208634 Jul 30 16:07:46.878948 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 75/159] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:46 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:46.968113 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-eede4832-d13e-47b1-8b2e-32cd1d0b7f03 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:46.976004 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-eede4832-d13e-47b1-8b2e-32cd1d0b7f03 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.180012 Jul 30 16:07:46.985809 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 85/160] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:46 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:47.646425 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9256ea9c-0b50-4e07-9f4c-12d72c6c989f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:47.647031 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9256ea9c-0b50-4e07-9f4c-12d72c6c989f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:47.652951 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9256ea9c-0b50-4e07-9f4c-12d72c6c989f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:47.653402 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9256ea9c-0b50-4e07-9f4c-12d72c6c989f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:47.654169 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9256ea9c-0b50-4e07-9f4c-12d72c6c989f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:47.654614 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9256ea9c-0b50-4e07-9f4c-12d72c6c989f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:47.776043 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9256ea9c-0b50-4e07-9f4c-12d72c6c989f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:47.784013 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9256ea9c-0b50-4e07-9f4c-12d72c6c989f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:47.785511 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9256ea9c-0b50-4e07-9f4c-12d72c6c989f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:47.786589 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9256ea9c-0b50-4e07-9f4c-12d72c6c989f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.143921 Jul 30 16:07:47.787169 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 76/161] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:47 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:47.896815 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-96e7d1d2-c815-4548-878f-dd8cadba7cbc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:47.897425 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-96e7d1d2-c815-4548-878f-dd8cadba7cbc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:47.903289 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-96e7d1d2-c815-4548-878f-dd8cadba7cbc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:47.903740 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-96e7d1d2-c815-4548-878f-dd8cadba7cbc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:47.904508 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-96e7d1d2-c815-4548-878f-dd8cadba7cbc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:47.904944 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-96e7d1d2-c815-4548-878f-dd8cadba7cbc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:47.992559 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3023de42-d732-4874-87d4-b7d7a9a088ac tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:47.993163 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-3023de42-d732-4874-87d4-b7d7a9a088ac tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:47.998985 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3023de42-d732-4874-87d4-b7d7a9a088ac tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:47.999455 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3023de42-d732-4874-87d4-b7d7a9a088ac tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:48.001033 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3023de42-d732-4874-87d4-b7d7a9a088ac tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:48.001466 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3023de42-d732-4874-87d4-b7d7a9a088ac tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:48.027417 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-96e7d1d2-c815-4548-878f-dd8cadba7cbc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:48.034746 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-96e7d1d2-c815-4548-878f-dd8cadba7cbc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.141504 Jul 30 16:07:48.035331 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 86/162] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:47 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:48.123110 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3023de42-d732-4874-87d4-b7d7a9a088ac tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:48.131065 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-3023de42-d732-4874-87d4-b7d7a9a088ac tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.142148 Jul 30 16:07:48.131819 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 77/163] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:47 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:48.604530 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-06a093f9-e0eb-4a0e-951a-5db5803a5fa6 req-078812c5-853e-4c20-9144-bb43d90d4ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f429942e-bf01-4d55-9cb0-29cdf5d6fef6", "name": "network-vif-plugged", "status": "completed", "tag": "4f9fcb96-116b-472f-84aa-c777e2358cb4"}, {"server_uuid": "dbd5216c-577d-42c9-a471-a99a85090a20", "name": "network-vif-plugged", "status": "completed", "tag": "bad8026f-4849-4e27-85b3-69b75386ebbf"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:48.604530 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:07:48.604530 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:07:48.610096 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-06a093f9-e0eb-4a0e-951a-5db5803a5fa6 req-078812c5-853e-4c20-9144-bb43d90d4ebe service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:48.610549 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-06a093f9-e0eb-4a0e-951a-5db5803a5fa6 req-078812c5-853e-4c20-9144-bb43d90d4ebe service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:48.622795 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-06a093f9-e0eb-4a0e-951a-5db5803a5fa6 req-078812c5-853e-4c20-9144-bb43d90d4ebe service nova] Creating event network-vif-plugged:4f9fcb96-116b-472f-84aa-c777e2358cb4 for instance f429942e-bf01-4d55-9cb0-29cdf5d6fef6 on hv-cinder-80304 Jul 30 16:07:48.623338 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-06a093f9-e0eb-4a0e-951a-5db5803a5fa6 req-078812c5-853e-4c20-9144-bb43d90d4ebe service nova] Creating event network-vif-plugged:bad8026f-4849-4e27-85b3-69b75386ebbf for instance dbd5216c-577d-42c9-a471-a99a85090a20 on hv-cinder-80304 Jul 30 16:07:48.630117 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-06a093f9-e0eb-4a0e-951a-5db5803a5fa6 req-078812c5-853e-4c20-9144-bb43d90d4ebe service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033259 Jul 30 16:07:48.630689 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 87/164] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:07:48 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:07:48.804811 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3cb79f2f-56b5-44f9-91e0-a655b497cd4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:48.805419 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-3cb79f2f-56b5-44f9-91e0-a655b497cd4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:48.811307 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3cb79f2f-56b5-44f9-91e0-a655b497cd4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:48.811813 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3cb79f2f-56b5-44f9-91e0-a655b497cd4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:48.813162 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3cb79f2f-56b5-44f9-91e0-a655b497cd4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:48.813601 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3cb79f2f-56b5-44f9-91e0-a655b497cd4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:48.930992 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3cb79f2f-56b5-44f9-91e0-a655b497cd4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:48.939387 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3cb79f2f-56b5-44f9-91e0-a655b497cd4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:48.940881 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3cb79f2f-56b5-44f9-91e0-a655b497cd4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:48.941937 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-3cb79f2f-56b5-44f9-91e0-a655b497cd4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.140873 Jul 30 16:07:48.942491 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 78/165] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:48 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:49.052085 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-58c678c2-485d-43ce-be02-f4f1347b3f74 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:49.052766 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-58c678c2-485d-43ce-be02-f4f1347b3f74 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:49.058734 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-58c678c2-485d-43ce-be02-f4f1347b3f74 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:49.059201 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-58c678c2-485d-43ce-be02-f4f1347b3f74 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:49.059959 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-58c678c2-485d-43ce-be02-f4f1347b3f74 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:49.060417 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-58c678c2-485d-43ce-be02-f4f1347b3f74 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:49.147226 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2408e20a-f873-44fa-aff4-eb0e2dd64d48 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:49.147837 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-2408e20a-f873-44fa-aff4-eb0e2dd64d48 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:49.153912 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2408e20a-f873-44fa-aff4-eb0e2dd64d48 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:49.154360 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2408e20a-f873-44fa-aff4-eb0e2dd64d48 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:49.155145 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2408e20a-f873-44fa-aff4-eb0e2dd64d48 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:49.155660 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2408e20a-f873-44fa-aff4-eb0e2dd64d48 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:49.180720 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-58c678c2-485d-43ce-be02-f4f1347b3f74 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:49.197320 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-58c678c2-485d-43ce-be02-f4f1347b3f74 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.149059 Jul 30 16:07:49.198093 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 88/166] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:49 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:49.291725 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-2408e20a-f873-44fa-aff4-eb0e2dd64d48 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:49.298955 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2408e20a-f873-44fa-aff4-eb0e2dd64d48 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.155276 Jul 30 16:07:49.299555 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 79/167] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:49 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:49.960108 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c5f21d24-1ab0-486b-81e1-4aef534a0a16 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:49.960706 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c5f21d24-1ab0-486b-81e1-4aef534a0a16 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:49.966868 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c5f21d24-1ab0-486b-81e1-4aef534a0a16 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:49.967362 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c5f21d24-1ab0-486b-81e1-4aef534a0a16 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:49.968137 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c5f21d24-1ab0-486b-81e1-4aef534a0a16 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:49.969185 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c5f21d24-1ab0-486b-81e1-4aef534a0a16 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:50.088670 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c5f21d24-1ab0-486b-81e1-4aef534a0a16 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:50.097066 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c5f21d24-1ab0-486b-81e1-4aef534a0a16 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:50.098568 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c5f21d24-1ab0-486b-81e1-4aef534a0a16 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:50.099683 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c5f21d24-1ab0-486b-81e1-4aef534a0a16 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.143932 Jul 30 16:07:50.100243 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 89/168] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:49 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:50.214585 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ba893952-c341-4ef6-ab04-f4db8ee7a800 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:50.215222 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ba893952-c341-4ef6-ab04-f4db8ee7a800 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:50.221519 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ba893952-c341-4ef6-ab04-f4db8ee7a800 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:50.221966 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ba893952-c341-4ef6-ab04-f4db8ee7a800 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:50.222726 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ba893952-c341-4ef6-ab04-f4db8ee7a800 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:50.223192 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ba893952-c341-4ef6-ab04-f4db8ee7a800 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:50.315093 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-371c301e-e1aa-494e-9d3a-23399d32607a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:50.315716 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-371c301e-e1aa-494e-9d3a-23399d32607a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:50.321627 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-371c301e-e1aa-494e-9d3a-23399d32607a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:50.322076 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-371c301e-e1aa-494e-9d3a-23399d32607a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:50.322846 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-371c301e-e1aa-494e-9d3a-23399d32607a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:50.323310 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-371c301e-e1aa-494e-9d3a-23399d32607a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:50.353932 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ba893952-c341-4ef6-ab04-f4db8ee7a800 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:50.361254 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ba893952-c341-4ef6-ab04-f4db8ee7a800 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.150257 Jul 30 16:07:50.361825 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 80/169] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:50 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:50.445300 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-371c301e-e1aa-494e-9d3a-23399d32607a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:50.452369 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-371c301e-e1aa-494e-9d3a-23399d32607a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.140885 Jul 30 16:07:50.453444 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 90/170] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:50 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:51.118753 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c6ca36cf-4421-4d34-9508-16246c22dda8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:51.119382 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c6ca36cf-4421-4d34-9508-16246c22dda8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:51.125830 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c6ca36cf-4421-4d34-9508-16246c22dda8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:51.126281 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c6ca36cf-4421-4d34-9508-16246c22dda8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:51.127047 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c6ca36cf-4421-4d34-9508-16246c22dda8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:51.127515 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c6ca36cf-4421-4d34-9508-16246c22dda8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:51.249293 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c6ca36cf-4421-4d34-9508-16246c22dda8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:51.257925 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c6ca36cf-4421-4d34-9508-16246c22dda8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:51.259443 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c6ca36cf-4421-4d34-9508-16246c22dda8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:51.260513 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c6ca36cf-4421-4d34-9508-16246c22dda8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.145462 Jul 30 16:07:51.261088 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 81/171] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:51 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:51.378177 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6951ae7c-dbdb-4fe4-bfc8-e31eabb7b920 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:51.378903 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6951ae7c-dbdb-4fe4-bfc8-e31eabb7b920 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:51.385363 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6951ae7c-dbdb-4fe4-bfc8-e31eabb7b920 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:51.385813 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6951ae7c-dbdb-4fe4-bfc8-e31eabb7b920 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:51.386576 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6951ae7c-dbdb-4fe4-bfc8-e31eabb7b920 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:51.387018 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6951ae7c-dbdb-4fe4-bfc8-e31eabb7b920 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:51.470079 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-56138117-1ad9-44dd-aa58-2b30454f1af7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:51.470913 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-56138117-1ad9-44dd-aa58-2b30454f1af7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:51.476726 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56138117-1ad9-44dd-aa58-2b30454f1af7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:51.477283 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56138117-1ad9-44dd-aa58-2b30454f1af7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:51.477953 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56138117-1ad9-44dd-aa58-2b30454f1af7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:51.478389 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56138117-1ad9-44dd-aa58-2b30454f1af7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:51.521266 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6951ae7c-dbdb-4fe4-bfc8-e31eabb7b920 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:51.528645 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6951ae7c-dbdb-4fe4-bfc8-e31eabb7b920 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.154713 Jul 30 16:07:51.529214 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 91/172] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:51 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:51.601682 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-56138117-1ad9-44dd-aa58-2b30454f1af7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:51.608829 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-56138117-1ad9-44dd-aa58-2b30454f1af7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.143176 Jul 30 16:07:51.609975 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 82/173] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:51 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:52.277879 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6930ddb1-c85f-4cc3-ae4d-570fc8b38a76 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:52.278446 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6930ddb1-c85f-4cc3-ae4d-570fc8b38a76 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:52.284340 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6930ddb1-c85f-4cc3-ae4d-570fc8b38a76 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:52.284793 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6930ddb1-c85f-4cc3-ae4d-570fc8b38a76 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:52.285611 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6930ddb1-c85f-4cc3-ae4d-570fc8b38a76 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:52.286126 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6930ddb1-c85f-4cc3-ae4d-570fc8b38a76 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:52.418353 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6930ddb1-c85f-4cc3-ae4d-570fc8b38a76 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:52.426313 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6930ddb1-c85f-4cc3-ae4d-570fc8b38a76 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:52.427849 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6930ddb1-c85f-4cc3-ae4d-570fc8b38a76 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:52.428924 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6930ddb1-c85f-4cc3-ae4d-570fc8b38a76 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1407 microversion: 2.20 time: 0.154864 Jul 30 16:07:52.429482 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 92/174] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:52 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:52.545258 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-149c776c-b17b-4dfd-ae74-449905aff80d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:52.545872 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-149c776c-b17b-4dfd-ae74-449905aff80d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:52.552088 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-149c776c-b17b-4dfd-ae74-449905aff80d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:52.552543 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-149c776c-b17b-4dfd-ae74-449905aff80d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:52.553311 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-149c776c-b17b-4dfd-ae74-449905aff80d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:52.553991 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-149c776c-b17b-4dfd-ae74-449905aff80d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:52.626069 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-275b7fd9-90ae-4f10-a7e0-623c847eb268 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:52.626679 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-275b7fd9-90ae-4f10-a7e0-623c847eb268 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:52.632518 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-275b7fd9-90ae-4f10-a7e0-623c847eb268 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:52.633189 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-275b7fd9-90ae-4f10-a7e0-623c847eb268 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:52.634105 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-275b7fd9-90ae-4f10-a7e0-623c847eb268 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:52.634710 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-275b7fd9-90ae-4f10-a7e0-623c847eb268 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:52.679971 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-149c776c-b17b-4dfd-ae74-449905aff80d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:52.687829 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-149c776c-b17b-4dfd-ae74-449905aff80d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.145648 Jul 30 16:07:52.688396 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 83/175] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:52 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:52.760018 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-275b7fd9-90ae-4f10-a7e0-623c847eb268 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:52.767954 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-275b7fd9-90ae-4f10-a7e0-623c847eb268 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.146056 Jul 30 16:07:52.768532 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 93/176] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:52 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:53.447155 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-93c28fa9-8d3c-4f0e-bd43-f61fb4c6327d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:53.447761 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-93c28fa9-8d3c-4f0e-bd43-f61fb4c6327d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:53.453583 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93c28fa9-8d3c-4f0e-bd43-f61fb4c6327d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:53.454032 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93c28fa9-8d3c-4f0e-bd43-f61fb4c6327d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:53.454799 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93c28fa9-8d3c-4f0e-bd43-f61fb4c6327d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:53.455266 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93c28fa9-8d3c-4f0e-bd43-f61fb4c6327d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:53.578312 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-93c28fa9-8d3c-4f0e-bd43-f61fb4c6327d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:53.586289 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-93c28fa9-8d3c-4f0e-bd43-f61fb4c6327d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:53.587881 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-93c28fa9-8d3c-4f0e-bd43-f61fb4c6327d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:53.589019 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-93c28fa9-8d3c-4f0e-bd43-f61fb4c6327d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1598 microversion: 2.20 time: 0.145575 Jul 30 16:07:53.589579 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 84/177] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:07:53 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1598 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:07:53.606750 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-30a0b259-2c91-4333-b2c5-6bd8af4c6cd7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:53.607278 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-30a0b259-2c91-4333-b2c5-6bd8af4c6cd7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:53.613655 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-30a0b259-2c91-4333-b2c5-6bd8af4c6cd7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:53.614100 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-30a0b259-2c91-4333-b2c5-6bd8af4c6cd7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:53.614862 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-30a0b259-2c91-4333-b2c5-6bd8af4c6cd7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:53.615338 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-30a0b259-2c91-4333-b2c5-6bd8af4c6cd7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:53.705201 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b8dd69f3-c8a6-480b-aed2-4c71e1c90742 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:53.710109 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-30a0b259-2c91-4333-b2c5-6bd8af4c6cd7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.106879 Jul 30 16:07:53.716526 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b8dd69f3-c8a6-480b-aed2-4c71e1c90742 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:53.723992 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 94/178] 10.222.0.37 () {60 vars in 1316 bytes} [Fri Jul 30 16:07:53 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:07:53.728785 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b8dd69f3-c8a6-480b-aed2-4c71e1c90742 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:53.729782 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b8dd69f3-c8a6-480b-aed2-4c71e1c90742 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:53.730940 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b8dd69f3-c8a6-480b-aed2-4c71e1c90742 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:53.731700 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b8dd69f3-c8a6-480b-aed2-4c71e1c90742 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:53.784618 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d019de95-71a9-4cf6-b995-a7d25ceef44e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:53.785531 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d019de95-71a9-4cf6-b995-a7d25ceef44e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:53.791652 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d019de95-71a9-4cf6-b995-a7d25ceef44e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:53.792312 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d019de95-71a9-4cf6-b995-a7d25ceef44e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:53.793324 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d019de95-71a9-4cf6-b995-a7d25ceef44e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:53.793921 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d019de95-71a9-4cf6-b995-a7d25ceef44e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:53.942872 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d019de95-71a9-4cf6-b995-a7d25ceef44e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:53.950300 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d019de95-71a9-4cf6-b995-a7d25ceef44e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1361 microversion: 2.1 time: 0.170167 Jul 30 16:07:53.950867 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 95/179] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:53 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:54.299344 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b8dd69f3-c8a6-480b-aed2-4c71e1c90742 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:54.306793 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b8dd69f3-c8a6-480b-aed2-4c71e1c90742 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.605685 Jul 30 16:07:54.307378 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 85/180] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:53 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:54.967282 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8a98f16a-b4fe-4856-a069-9e4c278950aa tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:54.968989 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8a98f16a-b4fe-4856-a069-9e4c278950aa tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:54.975937 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8a98f16a-b4fe-4856-a069-9e4c278950aa tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:54.977037 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8a98f16a-b4fe-4856-a069-9e4c278950aa tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:54.978062 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8a98f16a-b4fe-4856-a069-9e4c278950aa tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:54.978715 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8a98f16a-b4fe-4856-a069-9e4c278950aa tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:55.172727 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8a98f16a-b4fe-4856-a069-9e4c278950aa tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:55.180896 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8a98f16a-b4fe-4856-a069-9e4c278950aa tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1546 microversion: 2.1 time: 0.217579 Jul 30 16:07:55.182087 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 96/181] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:54 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1546 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:55.199064 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8b421d29-baee-4378-bf58-f20438071821 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:55.199652 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-8b421d29-baee-4378-bf58-f20438071821 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:55.206512 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8b421d29-baee-4378-bf58-f20438071821 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:55.207223 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8b421d29-baee-4378-bf58-f20438071821 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:55.208147 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8b421d29-baee-4378-bf58-f20438071821 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:55.208593 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8b421d29-baee-4378-bf58-f20438071821 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:55.320681 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8b421d29-baee-4378-bf58-f20438071821 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126138 Jul 30 16:07:55.321274 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 86/182] 10.222.0.37 () {58 vars in 1275 bytes} [Fri Jul 30 16:07:55 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:07:55.342020 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9db44cec-d585-4002-bc88-ed32ff008c9c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:55.342649 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9db44cec-d585-4002-bc88-ed32ff008c9c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:55.349636 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9db44cec-d585-4002-bc88-ed32ff008c9c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:55.350097 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9db44cec-d585-4002-bc88-ed32ff008c9c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:55.350922 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9db44cec-d585-4002-bc88-ed32ff008c9c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:55.351447 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9db44cec-d585-4002-bc88-ed32ff008c9c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:55.383945 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c00cec54-ac0c-468a-9270-4860bfb02258 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:55.384939 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c00cec54-ac0c-468a-9270-4860bfb02258 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:55.395460 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c00cec54-ac0c-468a-9270-4860bfb02258 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:55.395915 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c00cec54-ac0c-468a-9270-4860bfb02258 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:55.396755 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c00cec54-ac0c-468a-9270-4860bfb02258 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:55.397529 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c00cec54-ac0c-468a-9270-4860bfb02258 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:55.518331 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c00cec54-ac0c-468a-9270-4860bfb02258 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 14 microversion: 2.20 time: 0.136420 Jul 30 16:07:55.521470 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 87/183] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:07:55 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:55.552560 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-5a0509bd-cc00-4d55-96a3-b60aaff3accb req-e3e29e43-3560-4ac6-aeab-35b9d30c4e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb", "tag": "9138d528-69f5-4703-ba07-6f85b67dc617"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:55.554607 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:07:55.554607 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:07:55.563750 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-5a0509bd-cc00-4d55-96a3-b60aaff3accb req-e3e29e43-3560-4ac6-aeab-35b9d30c4e78 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:55.564472 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-5a0509bd-cc00-4d55-96a3-b60aaff3accb req-e3e29e43-3560-4ac6-aeab-35b9d30c4e78 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:55.577071 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-5a0509bd-cc00-4d55-96a3-b60aaff3accb req-e3e29e43-3560-4ac6-aeab-35b9d30c4e78 service nova] Creating event network-changed:9138d528-69f5-4703-ba07-6f85b67dc617 for instance ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb on hv-cinder-80304 Jul 30 16:07:55.584941 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-5a0509bd-cc00-4d55-96a3-b60aaff3accb req-e3e29e43-3560-4ac6-aeab-35b9d30c4e78 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050169 Jul 30 16:07:55.589934 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 88/184] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:07:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:07:55.636708 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-fa0283a8-6bb0-4251-a961-fb7f1e955f24 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:55.637549 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-fa0283a8-6bb0-4251-a961-fb7f1e955f24 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:55.646918 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fa0283a8-6bb0-4251-a961-fb7f1e955f24 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:55.648024 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fa0283a8-6bb0-4251-a961-fb7f1e955f24 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:55.649268 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fa0283a8-6bb0-4251-a961-fb7f1e955f24 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:55.649879 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fa0283a8-6bb0-4251-a961-fb7f1e955f24 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:55.680770 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-fa0283a8-6bb0-4251-a961-fb7f1e955f24 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Going to try to terminate instance {{(pid=107453) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:07:55.797613 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-fa0283a8-6bb0-4251-a961-fb7f1e955f24 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 204 len: 0 microversion: 2.1 time: 0.164061 Jul 30 16:07:55.799177 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 89/185] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:07:55 2021] DELETE /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 16:07:55.809860 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e3d2b3bf-ac58-4078-9371-dbf9e82f8152 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:55.810830 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e3d2b3bf-ac58-4078-9371-dbf9e82f8152 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:55.818620 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e3d2b3bf-ac58-4078-9371-dbf9e82f8152 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:55.819067 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e3d2b3bf-ac58-4078-9371-dbf9e82f8152 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:55.819967 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e3d2b3bf-ac58-4078-9371-dbf9e82f8152 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:55.820403 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e3d2b3bf-ac58-4078-9371-dbf9e82f8152 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:55.930682 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9db44cec-d585-4002-bc88-ed32ff008c9c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:55.942539 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9db44cec-d585-4002-bc88-ed32ff008c9c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.621665 Jul 30 16:07:55.948161 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 97/186] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:55 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:56.013360 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e3d2b3bf-ac58-4078-9371-dbf9e82f8152 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:56.026766 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e3d2b3bf-ac58-4078-9371-dbf9e82f8152 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1552 microversion: 2.1 time: 0.220855 Jul 30 16:07:56.028648 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 90/187] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:55 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1552 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:56.531043 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f0c92642-32aa-42e6-a499-6d85f675447e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:56.532082 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f0c92642-32aa-42e6-a499-6d85f675447e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:56.544649 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f0c92642-32aa-42e6-a499-6d85f675447e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:56.545002 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f0c92642-32aa-42e6-a499-6d85f675447e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:56.545787 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f0c92642-32aa-42e6-a499-6d85f675447e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:56.546219 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f0c92642-32aa-42e6-a499-6d85f675447e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:56.680980 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f0c92642-32aa-42e6-a499-6d85f675447e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 14 microversion: 2.20 time: 0.154325 Jul 30 16:07:56.681617 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 98/188] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:07:56 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:56.960360 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-51c8fcb3-f03b-4866-9deb-8699442fc995 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:56.961186 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-51c8fcb3-f03b-4866-9deb-8699442fc995 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:56.967642 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-51c8fcb3-f03b-4866-9deb-8699442fc995 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:56.968093 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-51c8fcb3-f03b-4866-9deb-8699442fc995 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:56.969385 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-51c8fcb3-f03b-4866-9deb-8699442fc995 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:56.969857 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-51c8fcb3-f03b-4866-9deb-8699442fc995 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:57.054750 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-45bd057e-062e-4df1-b1e4-d8f91ca86d2b tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:57.055501 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-45bd057e-062e-4df1-b1e4-d8f91ca86d2b tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:57.075532 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-45bd057e-062e-4df1-b1e4-d8f91ca86d2b tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:57.080021 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-45bd057e-062e-4df1-b1e4-d8f91ca86d2b tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:57.080688 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-45bd057e-062e-4df1-b1e4-d8f91ca86d2b tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:57.081130 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-45bd057e-062e-4df1-b1e4-d8f91ca86d2b tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:57.193332 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-51c8fcb3-f03b-4866-9deb-8699442fc995 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:57.203853 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-51c8fcb3-f03b-4866-9deb-8699442fc995 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.246636 Jul 30 16:07:57.213742 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 91/189] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:56 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:57.491490 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-45bd057e-062e-4df1-b1e4-d8f91ca86d2b tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:57.499449 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-45bd057e-062e-4df1-b1e4-d8f91ca86d2b tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1552 microversion: 2.1 time: 0.455982 Jul 30 16:07:57.500495 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 99/190] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:57 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1552 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:57.632114 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-ab2b7e05-e351-47a8-b4a6-acc4a43f7dbd req-1ac984c0-e800-4706-9ea1-b6c1ad5ecf54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbd5216c-577d-42c9-a471-a99a85090a20", "tag": "bad8026f-4849-4e27-85b3-69b75386ebbf"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:57.634588 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e58d57ba-62cb-4be5-b9eb-8b01a61ca54f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:57.635548 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e58d57ba-62cb-4be5-b9eb-8b01a61ca54f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:57.637772 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:07:57.637772 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:07:57.647838 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-ab2b7e05-e351-47a8-b4a6-acc4a43f7dbd req-1ac984c0-e800-4706-9ea1-b6c1ad5ecf54 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:57.648502 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-ab2b7e05-e351-47a8-b4a6-acc4a43f7dbd req-1ac984c0-e800-4706-9ea1-b6c1ad5ecf54 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:57.648758 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e58d57ba-62cb-4be5-b9eb-8b01a61ca54f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:57.649223 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e58d57ba-62cb-4be5-b9eb-8b01a61ca54f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:57.650010 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e58d57ba-62cb-4be5-b9eb-8b01a61ca54f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:57.650448 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e58d57ba-62cb-4be5-b9eb-8b01a61ca54f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:57.661048 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-ab2b7e05-e351-47a8-b4a6-acc4a43f7dbd req-1ac984c0-e800-4706-9ea1-b6c1ad5ecf54 service nova] Creating event network-changed:bad8026f-4849-4e27-85b3-69b75386ebbf for instance dbd5216c-577d-42c9-a471-a99a85090a20 on hv-cinder-80304 Jul 30 16:07:57.668255 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-ab2b7e05-e351-47a8-b4a6-acc4a43f7dbd req-1ac984c0-e800-4706-9ea1-b6c1ad5ecf54 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038754 Jul 30 16:07:57.670101 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 100/191] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:07:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:07:57.709502 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-4ec83874-936a-4cc5-b6c5-7d577605e840 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:57.710374 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-4ec83874-936a-4cc5-b6c5-7d577605e840 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:57.717659 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4ec83874-936a-4cc5-b6c5-7d577605e840 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:57.718024 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4ec83874-936a-4cc5-b6c5-7d577605e840 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:57.719234 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4ec83874-936a-4cc5-b6c5-7d577605e840 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:57.719697 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4ec83874-936a-4cc5-b6c5-7d577605e840 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:57.771592 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e58d57ba-62cb-4be5-b9eb-8b01a61ca54f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 14 microversion: 2.1 time: 0.146805 Jul 30 16:07:57.772601 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 92/192] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:07:57 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:07:57.829170 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-4ec83874-936a-4cc5-b6c5-7d577605e840 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 14 microversion: 2.20 time: 0.137946 Jul 30 16:07:57.833684 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 101/193] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:07:57 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:58.221566 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4db337a7-ff96-4477-8a19-4531fde96e2d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:58.222266 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4db337a7-ff96-4477-8a19-4531fde96e2d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:58.229006 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4db337a7-ff96-4477-8a19-4531fde96e2d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:58.229388 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4db337a7-ff96-4477-8a19-4531fde96e2d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:58.230420 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4db337a7-ff96-4477-8a19-4531fde96e2d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:58.231118 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4db337a7-ff96-4477-8a19-4531fde96e2d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:58.398502 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4db337a7-ff96-4477-8a19-4531fde96e2d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:58.407158 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4db337a7-ff96-4477-8a19-4531fde96e2d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.189708 Jul 30 16:07:58.411598 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 93/194] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:58 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:58.521928 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-53f27df9-2752-456b-8462-acb39e3d9e67 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:58.523042 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-53f27df9-2752-456b-8462-acb39e3d9e67 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:58.531491 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-53f27df9-2752-456b-8462-acb39e3d9e67 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:58.532627 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-53f27df9-2752-456b-8462-acb39e3d9e67 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:58.533696 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-53f27df9-2752-456b-8462-acb39e3d9e67 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:58.534586 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-53f27df9-2752-456b-8462-acb39e3d9e67 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:58.676300 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-53f27df9-2752-456b-8462-acb39e3d9e67 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:58.693981 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-53f27df9-2752-456b-8462-acb39e3d9e67 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1552 microversion: 2.1 time: 0.179252 Jul 30 16:07:58.693981 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 102/195] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:58 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1552 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:58.783755 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-511c0d1a-daba-400d-8528-a1358aa59846 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:58.784706 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-511c0d1a-daba-400d-8528-a1358aa59846 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:58.791173 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-511c0d1a-daba-400d-8528-a1358aa59846 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:58.791629 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-511c0d1a-daba-400d-8528-a1358aa59846 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:58.792422 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-511c0d1a-daba-400d-8528-a1358aa59846 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:58.792861 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-511c0d1a-daba-400d-8528-a1358aa59846 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:58.845283 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d36d3246-0534-4e08-a36c-63bb857ebc0a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:58.846644 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d36d3246-0534-4e08-a36c-63bb857ebc0a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:58.855425 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d36d3246-0534-4e08-a36c-63bb857ebc0a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:58.856030 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d36d3246-0534-4e08-a36c-63bb857ebc0a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:58.857305 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d36d3246-0534-4e08-a36c-63bb857ebc0a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:58.857910 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d36d3246-0534-4e08-a36c-63bb857ebc0a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:58.946377 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-511c0d1a-daba-400d-8528-a1358aa59846 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 14 microversion: 2.1 time: 0.166653 Jul 30 16:07:58.947264 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 94/196] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:07:58 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:07:58.991381 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d36d3246-0534-4e08-a36c-63bb857ebc0a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 14 microversion: 2.20 time: 0.154986 Jul 30 16:07:58.992399 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 103/197] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:07:58 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:59.424711 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3cf7308c-f1fd-4f2f-bffc-5110a3305495 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:59.425390 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-3cf7308c-f1fd-4f2f-bffc-5110a3305495 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:59.433274 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3cf7308c-f1fd-4f2f-bffc-5110a3305495 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:59.433730 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3cf7308c-f1fd-4f2f-bffc-5110a3305495 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:59.434508 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3cf7308c-f1fd-4f2f-bffc-5110a3305495 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:59.434939 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3cf7308c-f1fd-4f2f-bffc-5110a3305495 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:59.566502 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3cf7308c-f1fd-4f2f-bffc-5110a3305495 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:59.574565 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-3cf7308c-f1fd-4f2f-bffc-5110a3305495 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.154016 Jul 30 16:07:59.575805 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 95/198] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:59 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:07:59.711205 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1f9e014c-2684-4941-abdf-fc2e6ad084d7 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:07:59.711902 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1f9e014c-2684-4941-abdf-fc2e6ad084d7 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:59.719626 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f9e014c-2684-4941-abdf-fc2e6ad084d7 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:59.720578 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f9e014c-2684-4941-abdf-fc2e6ad084d7 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:59.721412 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f9e014c-2684-4941-abdf-fc2e6ad084d7 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:59.721834 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f9e014c-2684-4941-abdf-fc2e6ad084d7 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:59.845877 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1f9e014c-2684-4941-abdf-fc2e6ad084d7 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:07:59.853602 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1f9e014c-2684-4941-abdf-fc2e6ad084d7 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1552 microversion: 2.1 time: 0.146369 Jul 30 16:07:59.854540 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 104/199] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:07:59 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1552 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:07:59.958310 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-7269d4c8-8541-4b05-afdf-4bd4bd48d230 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:07:59.959441 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-7269d4c8-8541-4b05-afdf-4bd4bd48d230 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:07:59.965212 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7269d4c8-8541-4b05-afdf-4bd4bd48d230 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:59.965662 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7269d4c8-8541-4b05-afdf-4bd4bd48d230 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:07:59.966427 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7269d4c8-8541-4b05-afdf-4bd4bd48d230 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:07:59.966863 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7269d4c8-8541-4b05-afdf-4bd4bd48d230 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:00.003147 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e858d94e-0e9b-43c7-b717-0d7e89b0fb46 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:00.004047 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e858d94e-0e9b-43c7-b717-0d7e89b0fb46 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:00.009903 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e858d94e-0e9b-43c7-b717-0d7e89b0fb46 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:00.010348 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e858d94e-0e9b-43c7-b717-0d7e89b0fb46 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:00.011108 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e858d94e-0e9b-43c7-b717-0d7e89b0fb46 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:00.011560 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e858d94e-0e9b-43c7-b717-0d7e89b0fb46 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:00.081616 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-7269d4c8-8541-4b05-afdf-4bd4bd48d230 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 14 microversion: 2.1 time: 0.126808 Jul 30 16:08:00.084625 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 96/200] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:07:59 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 30 16:08:00.106213 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e858d94e-0e9b-43c7-b717-0d7e89b0fb46 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 14 microversion: 2.20 time: 0.107273 Jul 30 16:08:00.109783 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 105/201] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:07:59 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:08:00.594345 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-28d1bf30-963c-4b66-9452-0c7109aaaab5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:00.595646 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-28d1bf30-963c-4b66-9452-0c7109aaaab5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:00.602134 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-28d1bf30-963c-4b66-9452-0c7109aaaab5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:00.602577 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-28d1bf30-963c-4b66-9452-0c7109aaaab5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:00.603364 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-28d1bf30-963c-4b66-9452-0c7109aaaab5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:00.603794 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-28d1bf30-963c-4b66-9452-0c7109aaaab5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:00.732318 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-28d1bf30-963c-4b66-9452-0c7109aaaab5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:00.743055 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-28d1bf30-963c-4b66-9452-0c7109aaaab5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.152899 Jul 30 16:08:00.743980 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 97/202] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:00 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:00.750727 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-06b31053-3b2e-42f4-b5b3-84d1ef45eab8 req-bd224eb5-c3a1-4af2-8aab-0a2d00209974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26181d7-db01-409a-af4d-e60ceed08514", "name": "network-vif-deleted", "tag": "2722991c-02f6-4d1b-a307-ec06cfcdb383"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:00.752261 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:08:00.752261 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:08:00.770036 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-06b31053-3b2e-42f4-b5b3-84d1ef45eab8 req-bd224eb5-c3a1-4af2-8aab-0a2d00209974 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:00.770484 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-06b31053-3b2e-42f4-b5b3-84d1ef45eab8 req-bd224eb5-c3a1-4af2-8aab-0a2d00209974 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:00.782429 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-06b31053-3b2e-42f4-b5b3-84d1ef45eab8 req-bd224eb5-c3a1-4af2-8aab-0a2d00209974 service nova] Creating event network-vif-deleted:2722991c-02f6-4d1b-a307-ec06cfcdb383 for instance e26181d7-db01-409a-af4d-e60ceed08514 on hv-cinder-80304 Jul 30 16:08:00.787730 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-06b31053-3b2e-42f4-b5b3-84d1ef45eab8 req-bd224eb5-c3a1-4af2-8aab-0a2d00209974 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041196 Jul 30 16:08:00.788565 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 106/203] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:08:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:08:00.870773 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2df3d649-d482-40ff-a6a6-f1d2353ce85c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:00.871626 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-2df3d649-d482-40ff-a6a6-f1d2353ce85c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:00.879316 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2df3d649-d482-40ff-a6a6-f1d2353ce85c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:00.879771 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2df3d649-d482-40ff-a6a6-f1d2353ce85c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:00.880586 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2df3d649-d482-40ff-a6a6-f1d2353ce85c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:00.881019 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2df3d649-d482-40ff-a6a6-f1d2353ce85c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:00.941937 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-2df3d649-d482-40ff-a6a6-f1d2353ce85c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:00.950277 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2df3d649-d482-40ff-a6a6-f1d2353ce85c tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1345 microversion: 2.1 time: 0.084230 Jul 30 16:08:00.950844 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 98/204] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:00 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:01.092761 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c717e0c3-5ef0-4068-8731-f53d98cb38b8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:01.094483 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c717e0c3-5ef0-4068-8731-f53d98cb38b8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:01.100562 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c717e0c3-5ef0-4068-8731-f53d98cb38b8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:01.101008 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c717e0c3-5ef0-4068-8731-f53d98cb38b8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:01.101794 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c717e0c3-5ef0-4068-8731-f53d98cb38b8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:01.102226 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c717e0c3-5ef0-4068-8731-f53d98cb38b8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:01.120121 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1caf1a22-682d-4b58-86ea-37e3dba9f13d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:01.121125 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1caf1a22-682d-4b58-86ea-37e3dba9f13d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:01.127919 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1caf1a22-682d-4b58-86ea-37e3dba9f13d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:01.129128 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1caf1a22-682d-4b58-86ea-37e3dba9f13d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:01.130234 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1caf1a22-682d-4b58-86ea-37e3dba9f13d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:01.130934 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1caf1a22-682d-4b58-86ea-37e3dba9f13d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:01.210730 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c717e0c3-5ef0-4068-8731-f53d98cb38b8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 14 microversion: 2.1 time: 0.121828 Jul 30 16:08:01.211429 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 107/205] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:01 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:08:01.231533 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1caf1a22-682d-4b58-86ea-37e3dba9f13d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 14 microversion: 2.20 time: 0.115694 Jul 30 16:08:01.234852 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 99/206] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:01 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:01.760803 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-4f09b71f-4aa2-4c91-bfec-35213231a6e4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:01.761595 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-4f09b71f-4aa2-4c91-bfec-35213231a6e4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:01.768613 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4f09b71f-4aa2-4c91-bfec-35213231a6e4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:01.769145 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4f09b71f-4aa2-4c91-bfec-35213231a6e4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:01.770008 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4f09b71f-4aa2-4c91-bfec-35213231a6e4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:01.770561 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4f09b71f-4aa2-4c91-bfec-35213231a6e4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:01.934738 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-4f09b71f-4aa2-4c91-bfec-35213231a6e4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:01.942569 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-4f09b71f-4aa2-4c91-bfec-35213231a6e4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.185741 Jul 30 16:08:01.943146 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 108/207] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:01 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:01.969637 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-59d4a46e-7705-4252-9c96-97544baa99a8 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:01.970357 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-59d4a46e-7705-4252-9c96-97544baa99a8 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:01.977063 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-59d4a46e-7705-4252-9c96-97544baa99a8 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:01.977513 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-59d4a46e-7705-4252-9c96-97544baa99a8 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:01.978418 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-59d4a46e-7705-4252-9c96-97544baa99a8 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:01.978905 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-59d4a46e-7705-4252-9c96-97544baa99a8 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:02.022028 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-59d4a46e-7705-4252-9c96-97544baa99a8 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:02.022467 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-59d4a46e-7705-4252-9c96-97544baa99a8 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:02.023086 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.objects.instance [None req-59d4a46e-7705-4252-9c96-97544baa99a8 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lazy-loading 'fault' on Instance uuid e26181d7-db01-409a-af4d-e60ceed08514 {{(pid=107453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:08:02.087696 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-59d4a46e-7705-4252-9c96-97544baa99a8 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d02759bebc64429b082b22246bb2f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aea870288784c9c87d2bdaf98594503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:02.096655 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-59d4a46e-7705-4252-9c96-97544baa99a8 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 200 len: 1350 microversion: 2.1 time: 0.132452 Jul 30 16:08:02.097227 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 100/208] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:01 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 1350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:08:02.224141 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-20e53710-37ac-4e83-99ca-6fb2d7cce273 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:02.226014 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-20e53710-37ac-4e83-99ca-6fb2d7cce273 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:02.232247 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-20e53710-37ac-4e83-99ca-6fb2d7cce273 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:02.232698 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-20e53710-37ac-4e83-99ca-6fb2d7cce273 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:02.233770 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-20e53710-37ac-4e83-99ca-6fb2d7cce273 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:02.234555 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-20e53710-37ac-4e83-99ca-6fb2d7cce273 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:02.242252 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-7535d276-a877-40b3-88c3-b343b539cb3b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:02.243078 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-7535d276-a877-40b3-88c3-b343b539cb3b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:02.250585 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7535d276-a877-40b3-88c3-b343b539cb3b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:02.251171 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7535d276-a877-40b3-88c3-b343b539cb3b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:02.254027 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7535d276-a877-40b3-88c3-b343b539cb3b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:02.254639 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7535d276-a877-40b3-88c3-b343b539cb3b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:02.342741 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-20e53710-37ac-4e83-99ca-6fb2d7cce273 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 14 microversion: 2.1 time: 0.124546 Jul 30 16:08:02.344012 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 109/209] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:02 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:08:02.360499 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-7535d276-a877-40b3-88c3-b343b539cb3b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 14 microversion: 2.20 time: 0.121829 Jul 30 16:08:02.361124 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 101/210] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:02 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:02.959933 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f6b1d568-43b1-477c-9808-d4fc58d9558f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:02.960634 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f6b1d568-43b1-477c-9808-d4fc58d9558f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:02.967006 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f6b1d568-43b1-477c-9808-d4fc58d9558f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:02.967489 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f6b1d568-43b1-477c-9808-d4fc58d9558f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:02.968759 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f6b1d568-43b1-477c-9808-d4fc58d9558f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:02.969197 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f6b1d568-43b1-477c-9808-d4fc58d9558f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:03.097116 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f6b1d568-43b1-477c-9808-d4fc58d9558f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:03.104875 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f6b1d568-43b1-477c-9808-d4fc58d9558f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.148897 Jul 30 16:08:03.105608 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 110/211] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:02 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:03.113345 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-50da5906-1ea2-48b8-8311-f846ca832c6e tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:03.114053 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-50da5906-1ea2-48b8-8311-f846ca832c6e tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:03.120496 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-50da5906-1ea2-48b8-8311-f846ca832c6e tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:03.120948 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-50da5906-1ea2-48b8-8311-f846ca832c6e tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:03.121717 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-50da5906-1ea2-48b8-8311-f846ca832c6e tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:03.122152 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-50da5906-1ea2-48b8-8311-f846ca832c6e tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:03.135824 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-50da5906-1ea2-48b8-8311-f846ca832c6e tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] HTTP exception thrown: Instance e26181d7-db01-409a-af4d-e60ceed08514 could not be found. Jul 30 16:08:03.136462 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-50da5906-1ea2-48b8-8311-f846ca832c6e tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Returning 404 to user: Instance e26181d7-db01-409a-af4d-e60ceed08514 could not be found. {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:08:03.137319 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-50da5906-1ea2-48b8-8311-f846ca832c6e tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 404 len: 111 microversion: 2.1 time: 0.028017 Jul 30 16:08:03.138294 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 102/212] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:03 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:08:03.354339 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1732b0b1-095a-4152-ab37-10cda9d5251b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:03.355620 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1732b0b1-095a-4152-ab37-10cda9d5251b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:03.365715 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1732b0b1-095a-4152-ab37-10cda9d5251b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:03.365715 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1732b0b1-095a-4152-ab37-10cda9d5251b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:03.373813 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1732b0b1-095a-4152-ab37-10cda9d5251b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:03.374270 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1732b0b1-095a-4152-ab37-10cda9d5251b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:03.374735 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8ec15eb9-4b18-4ed7-b9f1-d5357473a68f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:03.377066 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-8ec15eb9-4b18-4ed7-b9f1-d5357473a68f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:03.385467 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8ec15eb9-4b18-4ed7-b9f1-d5357473a68f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:03.385983 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8ec15eb9-4b18-4ed7-b9f1-d5357473a68f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:03.387013 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8ec15eb9-4b18-4ed7-b9f1-d5357473a68f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:03.387835 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8ec15eb9-4b18-4ed7-b9f1-d5357473a68f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:03.470189 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1732b0b1-095a-4152-ab37-10cda9d5251b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 14 microversion: 2.1 time: 0.119750 Jul 30 16:08:03.470927 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 111/213] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:03 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:08:03.503704 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8ec15eb9-4b18-4ed7-b9f1-d5357473a68f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 14 microversion: 2.20 time: 0.135714 Jul 30 16:08:03.504342 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 103/214] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:03 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:04.121257 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f8e7cd09-afd4-47fd-8b2c-2ff5d2bf9dec tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:04.121946 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f8e7cd09-afd4-47fd-8b2c-2ff5d2bf9dec tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:04.128572 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f8e7cd09-afd4-47fd-8b2c-2ff5d2bf9dec tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:04.129022 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f8e7cd09-afd4-47fd-8b2c-2ff5d2bf9dec tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:04.129875 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f8e7cd09-afd4-47fd-8b2c-2ff5d2bf9dec tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:04.130317 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f8e7cd09-afd4-47fd-8b2c-2ff5d2bf9dec tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:04.260188 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f8e7cd09-afd4-47fd-8b2c-2ff5d2bf9dec tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:04.269657 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f8e7cd09-afd4-47fd-8b2c-2ff5d2bf9dec tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.152337 Jul 30 16:08:04.270417 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 112/215] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:04 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:04.450472 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-158c6583-6009-4bbb-8628-54ea7ef28301 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:04.451221 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-158c6583-6009-4bbb-8628-54ea7ef28301 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:04.459919 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-158c6583-6009-4bbb-8628-54ea7ef28301 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:04.460375 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-158c6583-6009-4bbb-8628-54ea7ef28301 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:04.461330 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-158c6583-6009-4bbb-8628-54ea7ef28301 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:04.461974 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-158c6583-6009-4bbb-8628-54ea7ef28301 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:04.476679 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-158c6583-6009-4bbb-8628-54ea7ef28301 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] HTTP exception thrown: Instance e26181d7-db01-409a-af4d-e60ceed08514 could not be found. Jul 30 16:08:04.477367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-158c6583-6009-4bbb-8628-54ea7ef28301 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Returning 404 to user: Instance e26181d7-db01-409a-af4d-e60ceed08514 could not be found. {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:08:04.478774 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-158c6583-6009-4bbb-8628-54ea7ef28301 tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 404 len: 111 microversion: 2.1 time: 0.033050 Jul 30 16:08:04.479560 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 104/216] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:08:04 2021] DELETE /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:08:04.486800 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-28a64af4-24ff-4dbc-85c2-cfc5b2d06019 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:04.487925 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-28a64af4-24ff-4dbc-85c2-cfc5b2d06019 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:04.488170 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f28ac9f8-364e-4965-a41f-513c49b7b8ff tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:04.488936 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f28ac9f8-364e-4965-a41f-513c49b7b8ff tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] [instance: e26181d7-db01-409a-af4d-e60ceed08514] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:04.494957 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f28ac9f8-364e-4965-a41f-513c49b7b8ff tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:04.495793 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f28ac9f8-364e-4965-a41f-513c49b7b8ff tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:04.496761 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f28ac9f8-364e-4965-a41f-513c49b7b8ff tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:04.497352 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f28ac9f8-364e-4965-a41f-513c49b7b8ff tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:04.497916 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-28a64af4-24ff-4dbc-85c2-cfc5b2d06019 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:04.498440 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-28a64af4-24ff-4dbc-85c2-cfc5b2d06019 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:04.499382 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-28a64af4-24ff-4dbc-85c2-cfc5b2d06019 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:04.500529 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-28a64af4-24ff-4dbc-85c2-cfc5b2d06019 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:04.513165 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-f28ac9f8-364e-4965-a41f-513c49b7b8ff tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] HTTP exception thrown: Instance e26181d7-db01-409a-af4d-e60ceed08514 could not be found. Jul 30 16:08:04.513966 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f28ac9f8-364e-4965-a41f-513c49b7b8ff tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] Returning 404 to user: Instance e26181d7-db01-409a-af4d-e60ceed08514 could not be found. {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:08:04.514977 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f28ac9f8-364e-4965-a41f-513c49b7b8ff tempest-DeleteServersTestJSON-1167834446 tempest-DeleteServersTestJSON-1167834446-project] 10.222.0.37 "GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514" status: 404 len: 111 microversion: 2.1 time: 0.031169 Jul 30 16:08:04.516346 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 105/217] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:04 2021] GET /compute/v2.1/servers/e26181d7-db01-409a-af4d-e60ceed08514 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:08:04.521576 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2bfdcc68-4dd9-463b-bd16-812bea81adff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:04.522744 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-2bfdcc68-4dd9-463b-bd16-812bea81adff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:04.529587 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2bfdcc68-4dd9-463b-bd16-812bea81adff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:04.530392 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2bfdcc68-4dd9-463b-bd16-812bea81adff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:04.531795 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2bfdcc68-4dd9-463b-bd16-812bea81adff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:04.531993 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2bfdcc68-4dd9-463b-bd16-812bea81adff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:04.608084 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-28a64af4-24ff-4dbc-85c2-cfc5b2d06019 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 14 microversion: 2.1 time: 0.128608 Jul 30 16:08:04.611276 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 113/218] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:04 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:08:04.630634 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2bfdcc68-4dd9-463b-bd16-812bea81adff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 14 microversion: 2.20 time: 0.112758 Jul 30 16:08:04.633914 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 106/219] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:04 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:05.288299 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-bd375c2e-7337-4647-9104-b5af84d740a4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:05.289696 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-bd375c2e-7337-4647-9104-b5af84d740a4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:05.298331 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bd375c2e-7337-4647-9104-b5af84d740a4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:05.298859 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bd375c2e-7337-4647-9104-b5af84d740a4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:05.299866 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bd375c2e-7337-4647-9104-b5af84d740a4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:05.300491 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bd375c2e-7337-4647-9104-b5af84d740a4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:05.474093 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-bd375c2e-7337-4647-9104-b5af84d740a4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:05.481499 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-bd375c2e-7337-4647-9104-b5af84d740a4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.199299 Jul 30 16:08:05.482067 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 114/220] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:05 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:08:05.620183 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-27e58538-c0c9-4cee-b757-c5b6bdac6f9f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:05.621183 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-27e58538-c0c9-4cee-b757-c5b6bdac6f9f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:05.628204 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-27e58538-c0c9-4cee-b757-c5b6bdac6f9f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:05.628792 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-27e58538-c0c9-4cee-b757-c5b6bdac6f9f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:05.629510 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-27e58538-c0c9-4cee-b757-c5b6bdac6f9f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:05.629947 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-27e58538-c0c9-4cee-b757-c5b6bdac6f9f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:05.643617 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-10de5625-0f1e-4c3d-9763-cc7e0b967715 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:05.644936 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-10de5625-0f1e-4c3d-9763-cc7e0b967715 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:05.653004 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-10de5625-0f1e-4c3d-9763-cc7e0b967715 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:05.654132 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-10de5625-0f1e-4c3d-9763-cc7e0b967715 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:05.655158 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-10de5625-0f1e-4c3d-9763-cc7e0b967715 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:05.655852 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-10de5625-0f1e-4c3d-9763-cc7e0b967715 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:05.751656 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-27e58538-c0c9-4cee-b757-c5b6bdac6f9f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 14 microversion: 2.1 time: 0.136005 Jul 30 16:08:05.752283 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 107/221] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:05 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:08:05.780459 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-10de5625-0f1e-4c3d-9763-cc7e0b967715 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 14 microversion: 2.20 time: 0.141284 Jul 30 16:08:05.782499 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 115/222] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:05 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:06.500411 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-5c769bd7-900f-495c-8f72-d772c78f102e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:06.501170 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-5c769bd7-900f-495c-8f72-d772c78f102e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:06.508029 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5c769bd7-900f-495c-8f72-d772c78f102e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:06.508554 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5c769bd7-900f-495c-8f72-d772c78f102e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:06.509340 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5c769bd7-900f-495c-8f72-d772c78f102e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:06.509775 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5c769bd7-900f-495c-8f72-d772c78f102e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:06.747284 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-5c769bd7-900f-495c-8f72-d772c78f102e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:06.755616 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-5c769bd7-900f-495c-8f72-d772c78f102e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.260194 Jul 30 16:08:06.756489 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 108/223] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:06 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:06.771365 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3c73ed9a-1d07-402b-9723-1ebeb0fb52de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:06.772489 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3c73ed9a-1d07-402b-9723-1ebeb0fb52de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:06.778886 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3c73ed9a-1d07-402b-9723-1ebeb0fb52de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:06.779505 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3c73ed9a-1d07-402b-9723-1ebeb0fb52de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:06.780324 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3c73ed9a-1d07-402b-9723-1ebeb0fb52de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:06.781434 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3c73ed9a-1d07-402b-9723-1ebeb0fb52de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:06.793651 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-fa1535f1-b4be-4e0a-b906-54b1f73ac917 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:06.795451 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-fa1535f1-b4be-4e0a-b906-54b1f73ac917 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:06.804485 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fa1535f1-b4be-4e0a-b906-54b1f73ac917 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:06.805200 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fa1535f1-b4be-4e0a-b906-54b1f73ac917 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:06.806192 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fa1535f1-b4be-4e0a-b906-54b1f73ac917 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:06.808175 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fa1535f1-b4be-4e0a-b906-54b1f73ac917 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:06.898798 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3c73ed9a-1d07-402b-9723-1ebeb0fb52de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 14 microversion: 2.1 time: 0.139915 Jul 30 16:08:06.902084 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 116/224] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:06 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:08:06.918957 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-fa1535f1-b4be-4e0a-b906-54b1f73ac917 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 14 microversion: 2.20 time: 0.129804 Jul 30 16:08:06.919631 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 109/225] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:06 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:07.643253 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0559bdcc-a603-4a92-8b47-c6d7690ba3eb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-870813727", "imageRef": "eea29a7d-10c3-489a-adee-10be2e7a26bd", "flavorRef": "452", "networks": [{"uuid": "9a836950-de83-4064-be6b-b98de3093a5e"}]}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:07.775163 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1bb8100c-2218-4e32-8b3a-7282c0bf8523 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:07.775967 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1bb8100c-2218-4e32-8b3a-7282c0bf8523 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:07.782784 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1bb8100c-2218-4e32-8b3a-7282c0bf8523 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:07.783377 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1bb8100c-2218-4e32-8b3a-7282c0bf8523 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:07.784286 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1bb8100c-2218-4e32-8b3a-7282c0bf8523 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:07.784849 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1bb8100c-2218-4e32-8b3a-7282c0bf8523 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:07.937513 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1bb8100c-2218-4e32-8b3a-7282c0bf8523 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:07.944711 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1bb8100c-2218-4e32-8b3a-7282c0bf8523 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.174122 Jul 30 16:08:07.945247 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 110/226] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:07 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:08:07.949452 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8004671b-6e6f-4471-84d9-3a554855464d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:07.950331 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-8004671b-6e6f-4471-84d9-3a554855464d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:07.955649 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8004671b-6e6f-4471-84d9-3a554855464d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:07.956091 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8004671b-6e6f-4471-84d9-3a554855464d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:07.956844 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8004671b-6e6f-4471-84d9-3a554855464d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:07.957272 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8004671b-6e6f-4471-84d9-3a554855464d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:08.055381 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8004671b-6e6f-4471-84d9-3a554855464d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 14 microversion: 2.1 time: 0.108718 Jul 30 16:08:08.056148 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 111/227] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:07 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:08:08.061970 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ca3874fb-a8bb-4352-b9a3-c5fa2895b76d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:08.063116 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ca3874fb-a8bb-4352-b9a3-c5fa2895b76d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:08.069687 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ca3874fb-a8bb-4352-b9a3-c5fa2895b76d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:08.070135 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ca3874fb-a8bb-4352-b9a3-c5fa2895b76d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:08.071002 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ca3874fb-a8bb-4352-b9a3-c5fa2895b76d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:08.071478 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ca3874fb-a8bb-4352-b9a3-c5fa2895b76d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:08.159364 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ca3874fb-a8bb-4352-b9a3-c5fa2895b76d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 14 microversion: 2.20 time: 0.101566 Jul 30 16:08:08.159938 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 112/228] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:08 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:08.962103 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c4fa7b00-0f0d-4353-bcc4-fc66b00c1535 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:08.962795 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c4fa7b00-0f0d-4353-bcc4-fc66b00c1535 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:08.969521 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c4fa7b00-0f0d-4353-bcc4-fc66b00c1535 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:08.969962 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c4fa7b00-0f0d-4353-bcc4-fc66b00c1535 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:08.970722 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c4fa7b00-0f0d-4353-bcc4-fc66b00c1535 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:08.971181 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c4fa7b00-0f0d-4353-bcc4-fc66b00c1535 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:09.091927 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c4fa7b00-0f0d-4353-bcc4-fc66b00c1535 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:09.099869 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c4fa7b00-0f0d-4353-bcc4-fc66b00c1535 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.141771 Jul 30 16:08:09.100484 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 113/229] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:08 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:08:09.104821 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-6d0582a0-76be-46cd-ab12-005ffaef490b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:09.105717 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-6d0582a0-76be-46cd-ab12-005ffaef490b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:09.111166 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6d0582a0-76be-46cd-ab12-005ffaef490b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:09.111628 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6d0582a0-76be-46cd-ab12-005ffaef490b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:09.112399 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6d0582a0-76be-46cd-ab12-005ffaef490b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:09.112835 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6d0582a0-76be-46cd-ab12-005ffaef490b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:12.550982 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-6d0582a0-76be-46cd-ab12-005ffaef490b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 14 microversion: 2.1 time: 3.449159 Jul 30 16:08:12.551731 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 114/230] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:09 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 14 bytes in 3451 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:08:12.556424 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-166d7f0c-4b9b-4c5f-bfc5-cbbb534f4a3d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:12.557400 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-166d7f0c-4b9b-4c5f-bfc5-cbbb534f4a3d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:12.563866 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-166d7f0c-4b9b-4c5f-bfc5-cbbb534f4a3d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:12.564313 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-166d7f0c-4b9b-4c5f-bfc5-cbbb534f4a3d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:12.565078 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-166d7f0c-4b9b-4c5f-bfc5-cbbb534f4a3d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:12.565510 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-166d7f0c-4b9b-4c5f-bfc5-cbbb534f4a3d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:12.642439 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-166d7f0c-4b9b-4c5f-bfc5-cbbb534f4a3d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 14 microversion: 2.20 time: 0.089507 Jul 30 16:08:12.643060 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 115/231] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:12 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:12.647776 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-549ea7f9-d134-4b23-ad04-51c955d185b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:12.648449 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-549ea7f9-d134-4b23-ad04-51c955d185b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:12.654738 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-549ea7f9-d134-4b23-ad04-51c955d185b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:12.655203 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-549ea7f9-d134-4b23-ad04-51c955d185b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:12.656682 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-549ea7f9-d134-4b23-ad04-51c955d185b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:12.657104 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-549ea7f9-d134-4b23-ad04-51c955d185b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:12.778017 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-549ea7f9-d134-4b23-ad04-51c955d185b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:12.787039 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-549ea7f9-d134-4b23-ad04-51c955d185b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.142714 Jul 30 16:08:12.787636 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 116/232] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:12 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:13.561421 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a7a4bbde-41e1-4321-b0bb-134e7c8b4a2b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:13.562292 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a7a4bbde-41e1-4321-b0bb-134e7c8b4a2b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:13.568263 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a7a4bbde-41e1-4321-b0bb-134e7c8b4a2b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:13.568780 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a7a4bbde-41e1-4321-b0bb-134e7c8b4a2b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:13.569558 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a7a4bbde-41e1-4321-b0bb-134e7c8b4a2b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:13.570142 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a7a4bbde-41e1-4321-b0bb-134e7c8b4a2b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:16.408002 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.network.neutron [None req-0559bdcc-a603-4a92-8b47-c6d7690ba3eb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] validate_networks() for [('9a836950-de83-4064-be6b-b98de3093a5e', None, None, None)] {{(pid=107452) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:08:16.758297 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-0559bdcc-a603-4a92-8b47-c6d7690ba3eb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Flavor limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:08:16.758726 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-0559bdcc-a603-4a92-8b47-c6d7690ba3eb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Image limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:08:16.759226 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-0559bdcc-a603-4a92-8b47-c6d7690ba3eb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Flavor pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:08:16.759698 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-0559bdcc-a603-4a92-8b47-c6d7690ba3eb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Image pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:08:16.760293 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-0559bdcc-a603-4a92-8b47-c6d7690ba3eb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:08:16.771570 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0559bdcc-a603-4a92-8b47-c6d7690ba3eb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:16.772023 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0559bdcc-a603-4a92-8b47-c6d7690ba3eb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:16.772855 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0559bdcc-a603-4a92-8b47-c6d7690ba3eb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:16.773299 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0559bdcc-a603-4a92-8b47-c6d7690ba3eb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:16.791368 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-0559bdcc-a603-4a92-8b47-c6d7690ba3eb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Getting quotas for project e9b01b7e6d90426088cefd5ff16e7347. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:08:16.795796 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-0559bdcc-a603-4a92-8b47-c6d7690ba3eb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Getting quotas for user 0f16217b495748478088d59006761959 and project e9b01b7e6d90426088cefd5ff16e7347. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:08:16.806777 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0559bdcc-a603-4a92-8b47-c6d7690ba3eb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Going to run 1 instances... {{(pid=107452) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:08:16.809239 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0559bdcc-a603-4a92-8b47-c6d7690ba3eb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eea29a7d-10c3-489a-adee-10be2e7a26bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:08:16.853090 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0559bdcc-a603-4a92-8b47-c6d7690ba3eb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.326623 Jul 30 16:08:16.853724 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 117/233] 10.222.0.37 () {60 vars in 1147 bytes} [Fri Jul 30 16:08:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 9328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 16:08:16.862405 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b791d370-fe62-41b4-bc66-ff5fb2d2dfd2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:16.863405 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b791d370-fe62-41b4-bc66-ff5fb2d2dfd2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:16.870290 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b791d370-fe62-41b4-bc66-ff5fb2d2dfd2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:16.870731 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b791d370-fe62-41b4-bc66-ff5fb2d2dfd2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:16.871858 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b791d370-fe62-41b4-bc66-ff5fb2d2dfd2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:16.871952 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b791d370-fe62-41b4-bc66-ff5fb2d2dfd2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:17.879874 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a7a4bbde-41e1-4321-b0bb-134e7c8b4a2b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 14 microversion: 2.1 time: 4.321896 Jul 30 16:08:17.880938 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 117/234] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:13 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 14 bytes in 4324 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 30 16:08:17.886979 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-59ca9ae4-72c6-43e2-828b-a0afd2d07c5b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:17.887939 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-59ca9ae4-72c6-43e2-828b-a0afd2d07c5b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:17.894461 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-59ca9ae4-72c6-43e2-828b-a0afd2d07c5b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:17.894913 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-59ca9ae4-72c6-43e2-828b-a0afd2d07c5b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:17.895723 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-59ca9ae4-72c6-43e2-828b-a0afd2d07c5b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:17.896162 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-59ca9ae4-72c6-43e2-828b-a0afd2d07c5b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:17.956736 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b791d370-fe62-41b4-bc66-ff5fb2d2dfd2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 14 microversion: 2.20 time: 1.101700 Jul 30 16:08:17.957373 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 118/235] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:16 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 14 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:17.964964 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-78f1cb53-5cd6-4203-a25e-e176c9ca9520 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:17.965661 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-78f1cb53-5cd6-4203-a25e-e176c9ca9520 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:17.973374 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-78f1cb53-5cd6-4203-a25e-e176c9ca9520 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:17.974080 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-78f1cb53-5cd6-4203-a25e-e176c9ca9520 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:17.974867 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-78f1cb53-5cd6-4203-a25e-e176c9ca9520 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:17.975338 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-78f1cb53-5cd6-4203-a25e-e176c9ca9520 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:18.031280 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-59ca9ae4-72c6-43e2-828b-a0afd2d07c5b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:18.039504 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-59ca9ae4-72c6-43e2-828b-a0afd2d07c5b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.157181 Jul 30 16:08:18.040241 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 118/236] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:17 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:18.049320 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-78f1cb53-5cd6-4203-a25e-e176c9ca9520 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:18.057500 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-78f1cb53-5cd6-4203-a25e-e176c9ca9520 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1221 microversion: 2.1 time: 0.096273 Jul 30 16:08:18.058053 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 119/237] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:17 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1221 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:18.891557 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-19277591-0ea1-4a6c-bef9-88f54cec689a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:18.892473 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-19277591-0ea1-4a6c-bef9-88f54cec689a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:18.898706 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-19277591-0ea1-4a6c-bef9-88f54cec689a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:18.899186 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-19277591-0ea1-4a6c-bef9-88f54cec689a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:18.899963 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-19277591-0ea1-4a6c-bef9-88f54cec689a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:18.900396 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-19277591-0ea1-4a6c-bef9-88f54cec689a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:18.967626 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-13ed202a-cc08-4739-a09e-06075e65a66e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:18.968616 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-13ed202a-cc08-4739-a09e-06075e65a66e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:18.974844 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-13ed202a-cc08-4739-a09e-06075e65a66e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:18.975332 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-13ed202a-cc08-4739-a09e-06075e65a66e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:18.976090 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-13ed202a-cc08-4739-a09e-06075e65a66e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:18.976516 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-13ed202a-cc08-4739-a09e-06075e65a66e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:18.983251 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-19277591-0ea1-4a6c-bef9-88f54cec689a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 14 microversion: 2.1 time: 0.095473 Jul 30 16:08:18.984557 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 119/238] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:18 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 30 16:08:19.056940 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ab5cb0df-0ea6-4f3e-8a1a-4e93d2708de8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:19.057580 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ab5cb0df-0ea6-4f3e-8a1a-4e93d2708de8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:19.064068 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ab5cb0df-0ea6-4f3e-8a1a-4e93d2708de8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:19.064525 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ab5cb0df-0ea6-4f3e-8a1a-4e93d2708de8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:19.065298 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ab5cb0df-0ea6-4f3e-8a1a-4e93d2708de8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:19.065735 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ab5cb0df-0ea6-4f3e-8a1a-4e93d2708de8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:19.072182 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-13ed202a-cc08-4739-a09e-06075e65a66e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 14 microversion: 2.20 time: 0.108018 Jul 30 16:08:19.072945 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 120/239] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:18 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:08:19.078172 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c0887ae2-75a7-48c5-823d-c35db2e1af4f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:19.078859 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c0887ae2-75a7-48c5-823d-c35db2e1af4f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:19.093107 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c0887ae2-75a7-48c5-823d-c35db2e1af4f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:19.094202 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c0887ae2-75a7-48c5-823d-c35db2e1af4f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:19.095357 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c0887ae2-75a7-48c5-823d-c35db2e1af4f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:19.096085 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c0887ae2-75a7-48c5-823d-c35db2e1af4f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:19.200073 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ab5cb0df-0ea6-4f3e-8a1a-4e93d2708de8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:19.208597 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ab5cb0df-0ea6-4f3e-8a1a-4e93d2708de8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.155646 Jul 30 16:08:19.209174 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 120/240] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:19 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:08:19.409095 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c0887ae2-75a7-48c5-823d-c35db2e1af4f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:19.436053 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c0887ae2-75a7-48c5-823d-c35db2e1af4f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1275 microversion: 2.1 time: 0.346913 Jul 30 16:08:19.437912 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 121/241] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:19 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1275 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:19.993863 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1438cc15-4270-452f-baea-f08f660dac78 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:19.994772 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1438cc15-4270-452f-baea-f08f660dac78 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:20.000969 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1438cc15-4270-452f-baea-f08f660dac78 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:20.001418 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1438cc15-4270-452f-baea-f08f660dac78 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:20.002419 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1438cc15-4270-452f-baea-f08f660dac78 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:20.002626 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1438cc15-4270-452f-baea-f08f660dac78 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:20.081650 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1438cc15-4270-452f-baea-f08f660dac78 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 14 microversion: 2.1 time: 0.091237 Jul 30 16:08:20.085034 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 121/242] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:19 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:08:20.085184 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-2c491d55-3bb0-4214-b031-9b2599ce5e4b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:20.085184 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-2c491d55-3bb0-4214-b031-9b2599ce5e4b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:20.090200 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2c491d55-3bb0-4214-b031-9b2599ce5e4b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:20.090822 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2c491d55-3bb0-4214-b031-9b2599ce5e4b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:20.091595 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2c491d55-3bb0-4214-b031-9b2599ce5e4b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:20.092094 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2c491d55-3bb0-4214-b031-9b2599ce5e4b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:20.171769 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-f1c4d1f5-b2e7-4606-b35e-3ec5d1edf3f4 req-6387d24e-f64f-4d55-8c29-2491b796538c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "babe3fe6-376a-4331-8d5d-c2dd904a9fa2", "tag": "145bce74-4c4f-477e-a0d9-380929929e79"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:20.178993 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:08:20.178993 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:08:20.185217 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-2c491d55-3bb0-4214-b031-9b2599ce5e4b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 14 microversion: 2.20 time: 0.106408 Jul 30 16:08:20.187345 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-f1c4d1f5-b2e7-4606-b35e-3ec5d1edf3f4 req-6387d24e-f64f-4d55-8c29-2491b796538c service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:20.187803 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-f1c4d1f5-b2e7-4606-b35e-3ec5d1edf3f4 req-6387d24e-f64f-4d55-8c29-2491b796538c service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:20.189631 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 122/243] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:20 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:08:20.205626 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-f1c4d1f5-b2e7-4606-b35e-3ec5d1edf3f4 req-6387d24e-f64f-4d55-8c29-2491b796538c service nova] Creating event network-changed:145bce74-4c4f-477e-a0d9-380929929e79 for instance babe3fe6-376a-4331-8d5d-c2dd904a9fa2 on hv-cinder-80304 Jul 30 16:08:20.211209 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-f1c4d1f5-b2e7-4606-b35e-3ec5d1edf3f4 req-6387d24e-f64f-4d55-8c29-2491b796538c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043590 Jul 30 16:08:20.212179 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 122/244] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:08:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:08:20.225817 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-85da4c47-2fe5-4dba-9a28-021389e1d5fe tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:20.226622 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-85da4c47-2fe5-4dba-9a28-021389e1d5fe tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:20.233782 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-85da4c47-2fe5-4dba-9a28-021389e1d5fe tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:20.234369 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-85da4c47-2fe5-4dba-9a28-021389e1d5fe tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:20.235227 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-85da4c47-2fe5-4dba-9a28-021389e1d5fe tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:20.235914 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-85da4c47-2fe5-4dba-9a28-021389e1d5fe tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:20.426874 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-85da4c47-2fe5-4dba-9a28-021389e1d5fe tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:20.435124 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-85da4c47-2fe5-4dba-9a28-021389e1d5fe tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.213501 Jul 30 16:08:20.436144 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 123/245] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:20 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:20.455612 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9743d9b0-de03-4f17-85cd-a7b43f62a3e0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:20.456304 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9743d9b0-de03-4f17-85cd-a7b43f62a3e0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:20.462609 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9743d9b0-de03-4f17-85cd-a7b43f62a3e0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:20.463054 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9743d9b0-de03-4f17-85cd-a7b43f62a3e0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:20.464066 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9743d9b0-de03-4f17-85cd-a7b43f62a3e0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:20.464738 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9743d9b0-de03-4f17-85cd-a7b43f62a3e0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:20.597584 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9743d9b0-de03-4f17-85cd-a7b43f62a3e0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:20.606044 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9743d9b0-de03-4f17-85cd-a7b43f62a3e0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1317 microversion: 2.1 time: 0.155176 Jul 30 16:08:20.606708 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 123/246] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:20 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:21.092445 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-4ccde573-c70e-40ea-ac1f-0d394d6cb221 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:21.093629 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-4ccde573-c70e-40ea-ac1f-0d394d6cb221 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:21.099991 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4ccde573-c70e-40ea-ac1f-0d394d6cb221 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:21.100466 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4ccde573-c70e-40ea-ac1f-0d394d6cb221 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:21.101242 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4ccde573-c70e-40ea-ac1f-0d394d6cb221 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:21.101672 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4ccde573-c70e-40ea-ac1f-0d394d6cb221 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:21.196135 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4cd7efa3-6a8b-43cf-a3a1-d19c7869cead tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:21.197102 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4cd7efa3-6a8b-43cf-a3a1-d19c7869cead tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:21.203650 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4cd7efa3-6a8b-43cf-a3a1-d19c7869cead tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:21.204099 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4cd7efa3-6a8b-43cf-a3a1-d19c7869cead tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:21.204876 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4cd7efa3-6a8b-43cf-a3a1-d19c7869cead tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:21.205315 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4cd7efa3-6a8b-43cf-a3a1-d19c7869cead tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:21.266510 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-4ccde573-c70e-40ea-ac1f-0d394d6cb221 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 4572 microversion: 2.1 time: 0.177464 Jul 30 16:08:21.269912 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 124/247] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:21 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 4572 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:21.321743 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4cd7efa3-6a8b-43cf-a3a1-d19c7869cead tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 4568 microversion: 2.20 time: 0.129163 Jul 30 16:08:21.322586 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 124/248] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:21 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 4568 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:08:21.452704 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-332242d2-de4c-4956-ad61-8c11ef8ed34f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:21.453413 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-332242d2-de4c-4956-ad61-8c11ef8ed34f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:21.459984 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-332242d2-de4c-4956-ad61-8c11ef8ed34f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:21.460429 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-332242d2-de4c-4956-ad61-8c11ef8ed34f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:21.461189 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-332242d2-de4c-4956-ad61-8c11ef8ed34f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:21.461623 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-332242d2-de4c-4956-ad61-8c11ef8ed34f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:21.594161 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-332242d2-de4c-4956-ad61-8c11ef8ed34f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:21.603086 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-332242d2-de4c-4956-ad61-8c11ef8ed34f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.154388 Jul 30 16:08:21.603708 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 125/249] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:21 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:21.623026 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-cd0c5280-05dd-4f3d-913e-794c7d4bebe6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:21.623780 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-cd0c5280-05dd-4f3d-913e-794c7d4bebe6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:21.630367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cd0c5280-05dd-4f3d-913e-794c7d4bebe6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:21.630819 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cd0c5280-05dd-4f3d-913e-794c7d4bebe6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:21.631616 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cd0c5280-05dd-4f3d-913e-794c7d4bebe6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:21.632051 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cd0c5280-05dd-4f3d-913e-794c7d4bebe6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:21.760916 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-cd0c5280-05dd-4f3d-913e-794c7d4bebe6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:21.770654 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-cd0c5280-05dd-4f3d-913e-794c7d4bebe6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1317 microversion: 2.1 time: 0.151574 Jul 30 16:08:21.771254 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 125/250] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:21 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:22.277778 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e1591c3c-440e-408b-9d03-ddea5abcb905 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:22.278811 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e1591c3c-440e-408b-9d03-ddea5abcb905 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:22.284629 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e1591c3c-440e-408b-9d03-ddea5abcb905 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:22.285080 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e1591c3c-440e-408b-9d03-ddea5abcb905 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:22.285849 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e1591c3c-440e-408b-9d03-ddea5abcb905 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:22.286284 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e1591c3c-440e-408b-9d03-ddea5abcb905 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:22.333732 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b46de720-5ff8-4154-ac7f-eb63d92acb7f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:22.334662 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b46de720-5ff8-4154-ac7f-eb63d92acb7f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:22.340505 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b46de720-5ff8-4154-ac7f-eb63d92acb7f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:22.340944 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b46de720-5ff8-4154-ac7f-eb63d92acb7f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:22.341728 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b46de720-5ff8-4154-ac7f-eb63d92acb7f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:22.342153 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b46de720-5ff8-4154-ac7f-eb63d92acb7f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:22.379075 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e1591c3c-440e-408b-9d03-ddea5abcb905 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 8523 microversion: 2.1 time: 0.105164 Jul 30 16:08:22.379732 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 126/251] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:22 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 8523 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:22.437971 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b46de720-5ff8-4154-ac7f-eb63d92acb7f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 8562 microversion: 2.20 time: 0.107810 Jul 30 16:08:22.438597 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 126/252] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:22 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 8562 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:08:22.622413 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-5e94d6d4-32fb-48cf-9cb1-d85558042dd4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:22.622413 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-5e94d6d4-32fb-48cf-9cb1-d85558042dd4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:22.629739 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5e94d6d4-32fb-48cf-9cb1-d85558042dd4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:22.630189 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5e94d6d4-32fb-48cf-9cb1-d85558042dd4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:22.630953 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5e94d6d4-32fb-48cf-9cb1-d85558042dd4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:22.631411 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5e94d6d4-32fb-48cf-9cb1-d85558042dd4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:22.748920 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-5e94d6d4-32fb-48cf-9cb1-d85558042dd4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:22.756261 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-5e94d6d4-32fb-48cf-9cb1-d85558042dd4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.138515 Jul 30 16:08:22.756824 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 127/253] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:22 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:22.789136 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f01be1e2-d068-4764-8b48-a91f42c59e9f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:22.790033 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f01be1e2-d068-4764-8b48-a91f42c59e9f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:22.797640 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f01be1e2-d068-4764-8b48-a91f42c59e9f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:22.798073 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f01be1e2-d068-4764-8b48-a91f42c59e9f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:22.798846 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f01be1e2-d068-4764-8b48-a91f42c59e9f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:22.799318 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f01be1e2-d068-4764-8b48-a91f42c59e9f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:22.919840 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f01be1e2-d068-4764-8b48-a91f42c59e9f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:22.927568 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f01be1e2-d068-4764-8b48-a91f42c59e9f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1317 microversion: 2.1 time: 0.143332 Jul 30 16:08:22.928135 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 127/254] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:22 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:23.390611 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3c8d2307-66e4-4291-96eb-9a805fb8806c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:23.391543 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3c8d2307-66e4-4291-96eb-9a805fb8806c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:23.397428 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3c8d2307-66e4-4291-96eb-9a805fb8806c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:23.397877 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3c8d2307-66e4-4291-96eb-9a805fb8806c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:23.398643 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3c8d2307-66e4-4291-96eb-9a805fb8806c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:23.399074 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3c8d2307-66e4-4291-96eb-9a805fb8806c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:23.449242 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-fb30896a-3ccc-41db-82bb-394a8a6e9e32 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:23.450137 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-fb30896a-3ccc-41db-82bb-394a8a6e9e32 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:23.455896 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fb30896a-3ccc-41db-82bb-394a8a6e9e32 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:23.456339 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fb30896a-3ccc-41db-82bb-394a8a6e9e32 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:23.457088 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fb30896a-3ccc-41db-82bb-394a8a6e9e32 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:23.457514 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fb30896a-3ccc-41db-82bb-394a8a6e9e32 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:27.324227 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3c8d2307-66e4-4291-96eb-9a805fb8806c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 17602 microversion: 2.1 time: 3.937465 Jul 30 16:08:27.324853 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 128/255] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:23 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 17602 bytes in 3939 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:08:27.330322 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b53a29fc-3fee-4d2f-aa73-47ffd3b6b668 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:27.330998 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b53a29fc-3fee-4d2f-aa73-47ffd3b6b668 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:27.337311 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b53a29fc-3fee-4d2f-aa73-47ffd3b6b668 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:27.337750 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b53a29fc-3fee-4d2f-aa73-47ffd3b6b668 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:27.338499 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b53a29fc-3fee-4d2f-aa73-47ffd3b6b668 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:27.338922 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b53a29fc-3fee-4d2f-aa73-47ffd3b6b668 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:27.346626 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-fb30896a-3ccc-41db-82bb-394a8a6e9e32 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 17744 microversion: 2.20 time: 3.900856 Jul 30 16:08:27.350284 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 128/256] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:23 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 17744 bytes in 3902 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:08:27.352257 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1bbb9c77-12d2-4e95-8afa-98f5a9eeac7c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:27.352941 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1bbb9c77-12d2-4e95-8afa-98f5a9eeac7c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:27.359404 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1bbb9c77-12d2-4e95-8afa-98f5a9eeac7c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:27.359853 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1bbb9c77-12d2-4e95-8afa-98f5a9eeac7c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:27.360618 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1bbb9c77-12d2-4e95-8afa-98f5a9eeac7c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:27.361052 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1bbb9c77-12d2-4e95-8afa-98f5a9eeac7c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:27.463975 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b53a29fc-3fee-4d2f-aa73-47ffd3b6b668 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:27.471998 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b53a29fc-3fee-4d2f-aa73-47ffd3b6b668 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.146004 Jul 30 16:08:27.472564 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 129/257] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:27 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:27.486762 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1bbb9c77-12d2-4e95-8afa-98f5a9eeac7c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:27.493923 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1bbb9c77-12d2-4e95-8afa-98f5a9eeac7c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1317 microversion: 2.1 time: 0.145331 Jul 30 16:08:27.494482 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 129/258] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:27 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:28.336304 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-28b35251-b3d9-43ae-a418-b659c2f6266f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:28.337332 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-28b35251-b3d9-43ae-a418-b659c2f6266f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:28.343909 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-28b35251-b3d9-43ae-a418-b659c2f6266f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:28.344436 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-28b35251-b3d9-43ae-a418-b659c2f6266f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:28.345273 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-28b35251-b3d9-43ae-a418-b659c2f6266f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:28.345771 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-28b35251-b3d9-43ae-a418-b659c2f6266f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:28.358209 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-43e819e8-b569-489c-9147-935d91d53ba1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:28.359514 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-43e819e8-b569-489c-9147-935d91d53ba1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:28.365992 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-43e819e8-b569-489c-9147-935d91d53ba1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:28.366602 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-43e819e8-b569-489c-9147-935d91d53ba1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:28.367420 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-43e819e8-b569-489c-9147-935d91d53ba1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:28.367862 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-43e819e8-b569-489c-9147-935d91d53ba1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:28.451507 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-28b35251-b3d9-43ae-a418-b659c2f6266f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 18701 microversion: 2.1 time: 0.118703 Jul 30 16:08:28.452371 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 130/259] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:28 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 18701 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:08:28.466207 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-43e819e8-b569-489c-9147-935d91d53ba1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 18816 microversion: 2.20 time: 0.111983 Jul 30 16:08:28.468018 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 130/260] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:28 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 18816 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:08:28.489221 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1e5dac1e-71a8-4160-95a5-dd700b130501 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:28.490021 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1e5dac1e-71a8-4160-95a5-dd700b130501 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:28.502612 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1e5dac1e-71a8-4160-95a5-dd700b130501 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:28.503055 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1e5dac1e-71a8-4160-95a5-dd700b130501 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:28.503854 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1e5dac1e-71a8-4160-95a5-dd700b130501 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:28.505657 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1e5dac1e-71a8-4160-95a5-dd700b130501 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:28.511063 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-05f09b17-cc57-4775-bb54-401780bf9b30 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:28.512611 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-05f09b17-cc57-4775-bb54-401780bf9b30 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:28.520535 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-05f09b17-cc57-4775-bb54-401780bf9b30 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:28.521138 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-05f09b17-cc57-4775-bb54-401780bf9b30 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:28.521762 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-05f09b17-cc57-4775-bb54-401780bf9b30 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:28.522296 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-05f09b17-cc57-4775-bb54-401780bf9b30 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:28.639192 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1e5dac1e-71a8-4160-95a5-dd700b130501 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:28.646742 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1e5dac1e-71a8-4160-95a5-dd700b130501 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.161860 Jul 30 16:08:28.647337 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 131/261] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:28 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:28.656914 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-05f09b17-cc57-4775-bb54-401780bf9b30 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:28.664985 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-05f09b17-cc57-4775-bb54-401780bf9b30 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1317 microversion: 2.1 time: 0.157850 Jul 30 16:08:28.665544 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 131/262] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:28 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:29.463810 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3b4c37bc-4dc3-48d4-9b78-d8f001927d2d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:29.464721 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3b4c37bc-4dc3-48d4-9b78-d8f001927d2d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:29.470670 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3b4c37bc-4dc3-48d4-9b78-d8f001927d2d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:29.471161 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3b4c37bc-4dc3-48d4-9b78-d8f001927d2d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:29.471957 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3b4c37bc-4dc3-48d4-9b78-d8f001927d2d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:29.472398 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3b4c37bc-4dc3-48d4-9b78-d8f001927d2d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:29.477694 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-09bde436-fadd-4562-8800-3a469fd0852c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:29.478623 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-09bde436-fadd-4562-8800-3a469fd0852c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:29.484965 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-09bde436-fadd-4562-8800-3a469fd0852c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:29.485411 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-09bde436-fadd-4562-8800-3a469fd0852c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:29.486203 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-09bde436-fadd-4562-8800-3a469fd0852c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:29.486632 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-09bde436-fadd-4562-8800-3a469fd0852c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:29.563531 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3b4c37bc-4dc3-48d4-9b78-d8f001927d2d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 19342 microversion: 2.1 time: 0.103155 Jul 30 16:08:29.564585 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 132/263] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:29 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 19342 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:08:29.585126 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-09bde436-fadd-4562-8800-3a469fd0852c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 19342 microversion: 2.20 time: 0.111009 Jul 30 16:08:29.586727 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 132/264] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:29 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 19342 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:08:29.665591 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e406b221-90d5-4ec6-b445-ad15e5976697 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:29.666281 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e406b221-90d5-4ec6-b445-ad15e5976697 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:29.673170 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e406b221-90d5-4ec6-b445-ad15e5976697 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:29.673623 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e406b221-90d5-4ec6-b445-ad15e5976697 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:29.674530 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e406b221-90d5-4ec6-b445-ad15e5976697 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:29.674965 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e406b221-90d5-4ec6-b445-ad15e5976697 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:29.682537 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-49a5bf9c-fc00-46b8-a325-55a2e42a6f43 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:29.683383 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-49a5bf9c-fc00-46b8-a325-55a2e42a6f43 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:29.691487 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-49a5bf9c-fc00-46b8-a325-55a2e42a6f43 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:29.691943 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-49a5bf9c-fc00-46b8-a325-55a2e42a6f43 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:29.693269 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-49a5bf9c-fc00-46b8-a325-55a2e42a6f43 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:29.693872 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-49a5bf9c-fc00-46b8-a325-55a2e42a6f43 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:29.814550 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e406b221-90d5-4ec6-b445-ad15e5976697 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:29.824007 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e406b221-90d5-4ec6-b445-ad15e5976697 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.162494 Jul 30 16:08:29.824772 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 133/265] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:29 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:08:29.843650 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-49a5bf9c-fc00-46b8-a325-55a2e42a6f43 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:29.850800 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-49a5bf9c-fc00-46b8-a325-55a2e42a6f43 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1317 microversion: 2.1 time: 0.172744 Jul 30 16:08:29.851412 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 133/266] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:29 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:08:30.576228 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-af4320c3-367b-46bf-bfb9-6f91ae9be33f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:30.577293 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-af4320c3-367b-46bf-bfb9-6f91ae9be33f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:30.583205 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-af4320c3-367b-46bf-bfb9-6f91ae9be33f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:30.583654 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-af4320c3-367b-46bf-bfb9-6f91ae9be33f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:30.584455 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-af4320c3-367b-46bf-bfb9-6f91ae9be33f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:30.584882 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-af4320c3-367b-46bf-bfb9-6f91ae9be33f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:30.597334 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f32d7882-ad4c-4d4f-8ec3-05875132ca1a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:30.598838 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f32d7882-ad4c-4d4f-8ec3-05875132ca1a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:30.604980 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f32d7882-ad4c-4d4f-8ec3-05875132ca1a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:30.605675 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f32d7882-ad4c-4d4f-8ec3-05875132ca1a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:30.606681 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f32d7882-ad4c-4d4f-8ec3-05875132ca1a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:30.607367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f32d7882-ad4c-4d4f-8ec3-05875132ca1a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:30.674389 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-af4320c3-367b-46bf-bfb9-6f91ae9be33f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 20593 microversion: 2.1 time: 0.101792 Jul 30 16:08:30.675195 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 134/267] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:30 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 20593 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:08:30.698995 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f32d7882-ad4c-4d4f-8ec3-05875132ca1a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 20984 microversion: 2.20 time: 0.105807 Jul 30 16:08:30.702814 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 134/268] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:30 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 20984 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:08:30.841685 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1879d2b6-b513-4d3a-ac01-c523f3a4adea tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:30.842382 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1879d2b6-b513-4d3a-ac01-c523f3a4adea tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:30.850883 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1879d2b6-b513-4d3a-ac01-c523f3a4adea tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:30.851366 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1879d2b6-b513-4d3a-ac01-c523f3a4adea tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:30.852163 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1879d2b6-b513-4d3a-ac01-c523f3a4adea tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:30.852591 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1879d2b6-b513-4d3a-ac01-c523f3a4adea tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:30.873671 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-6081282d-ac6f-4d01-9716-2038e7bb66ee tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:30.875336 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-6081282d-ac6f-4d01-9716-2038e7bb66ee tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:30.882592 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6081282d-ac6f-4d01-9716-2038e7bb66ee tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:30.883679 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6081282d-ac6f-4d01-9716-2038e7bb66ee tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:30.884758 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6081282d-ac6f-4d01-9716-2038e7bb66ee tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:30.885400 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6081282d-ac6f-4d01-9716-2038e7bb66ee tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:30.985896 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1879d2b6-b513-4d3a-ac01-c523f3a4adea tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:30.994735 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1879d2b6-b513-4d3a-ac01-c523f3a4adea tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.156925 Jul 30 16:08:30.995353 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 135/269] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:30 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:31.025430 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6081282d-ac6f-4d01-9716-2038e7bb66ee tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:31.033479 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-6081282d-ac6f-4d01-9716-2038e7bb66ee tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1317 microversion: 2.1 time: 0.169094 Jul 30 16:08:31.034030 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 135/270] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:30 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:31.685806 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f8b326d2-1796-4c41-aa98-d3a5a0297d1f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:31.686650 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f8b326d2-1796-4c41-aa98-d3a5a0297d1f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:31.692571 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f8b326d2-1796-4c41-aa98-d3a5a0297d1f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:31.693011 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f8b326d2-1796-4c41-aa98-d3a5a0297d1f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:31.693760 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f8b326d2-1796-4c41-aa98-d3a5a0297d1f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:31.694189 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f8b326d2-1796-4c41-aa98-d3a5a0297d1f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:31.709673 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9498256e-33d8-4cea-8ceb-ae2fe789def2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:31.710683 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9498256e-33d8-4cea-8ceb-ae2fe789def2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:31.716380 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9498256e-33d8-4cea-8ceb-ae2fe789def2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:31.716833 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9498256e-33d8-4cea-8ceb-ae2fe789def2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:31.717597 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9498256e-33d8-4cea-8ceb-ae2fe789def2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:31.718627 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9498256e-33d8-4cea-8ceb-ae2fe789def2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:31.781694 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f8b326d2-1796-4c41-aa98-d3a5a0297d1f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 21442 microversion: 2.1 time: 0.099442 Jul 30 16:08:31.782547 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 136/271] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:31 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 21442 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:08:31.800986 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9498256e-33d8-4cea-8ceb-ae2fe789def2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 21471 microversion: 2.20 time: 0.094775 Jul 30 16:08:31.801603 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 136/272] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:31 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 21471 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:08:32.012100 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-7a465e4b-97ae-403f-abb6-94a7af50f683 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:32.012796 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7a465e4b-97ae-403f-abb6-94a7af50f683 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:32.020028 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7a465e4b-97ae-403f-abb6-94a7af50f683 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:32.020515 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7a465e4b-97ae-403f-abb6-94a7af50f683 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:32.021492 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7a465e4b-97ae-403f-abb6-94a7af50f683 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:32.021929 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7a465e4b-97ae-403f-abb6-94a7af50f683 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:32.050745 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1fc696b6-6879-45be-9bf2-f0dfe8a305c7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:32.051469 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1fc696b6-6879-45be-9bf2-f0dfe8a305c7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:32.072308 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1fc696b6-6879-45be-9bf2-f0dfe8a305c7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:32.072762 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1fc696b6-6879-45be-9bf2-f0dfe8a305c7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:32.073550 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1fc696b6-6879-45be-9bf2-f0dfe8a305c7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:32.073984 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1fc696b6-6879-45be-9bf2-f0dfe8a305c7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:32.179420 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-7a465e4b-97ae-403f-abb6-94a7af50f683 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:32.193450 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-7a465e4b-97ae-403f-abb6-94a7af50f683 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.184863 Jul 30 16:08:32.194489 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 137/273] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:32 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:32.249846 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1fc696b6-6879-45be-9bf2-f0dfe8a305c7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:32.257039 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1fc696b6-6879-45be-9bf2-f0dfe8a305c7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1317 microversion: 2.1 time: 0.210934 Jul 30 16:08:32.257604 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 137/274] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:32 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:32.796938 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-f898ba71-36e9-4e2b-8a34-93b03369e06b req-77ecba04-c0cc-4784-9494-2bbeffce8b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "babe3fe6-376a-4331-8d5d-c2dd904a9fa2", "name": "network-vif-plugged", "status": "completed", "tag": "145bce74-4c4f-477e-a0d9-380929929e79"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:32.802615 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-20a03e8e-16cd-4519-a241-ed28b066ff6a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:32.803547 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-20a03e8e-16cd-4519-a241-ed28b066ff6a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:32.806816 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:08:32.806816 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:08:32.816064 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-f898ba71-36e9-4e2b-8a34-93b03369e06b req-77ecba04-c0cc-4784-9494-2bbeffce8b9c service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:32.816469 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-f898ba71-36e9-4e2b-8a34-93b03369e06b req-77ecba04-c0cc-4784-9494-2bbeffce8b9c service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:32.821330 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-20a03e8e-16cd-4519-a241-ed28b066ff6a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:32.821777 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-20a03e8e-16cd-4519-a241-ed28b066ff6a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:32.822755 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-20a03e8e-16cd-4519-a241-ed28b066ff6a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:32.823335 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-20a03e8e-16cd-4519-a241-ed28b066ff6a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:32.847124 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-f898ba71-36e9-4e2b-8a34-93b03369e06b req-77ecba04-c0cc-4784-9494-2bbeffce8b9c service nova] Creating event network-vif-plugged:145bce74-4c4f-477e-a0d9-380929929e79 for instance babe3fe6-376a-4331-8d5d-c2dd904a9fa2 on hv-cinder-80304 Jul 30 16:08:32.854510 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-f898ba71-36e9-4e2b-8a34-93b03369e06b req-77ecba04-c0cc-4784-9494-2bbeffce8b9c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061018 Jul 30 16:08:32.855146 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 138/275] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:08:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:08:32.860610 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-93ccd8ce-b105-4746-b31f-165ebc85ca9a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:32.861633 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-93ccd8ce-b105-4746-b31f-165ebc85ca9a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:32.867981 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93ccd8ce-b105-4746-b31f-165ebc85ca9a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:32.868426 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93ccd8ce-b105-4746-b31f-165ebc85ca9a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:32.869212 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93ccd8ce-b105-4746-b31f-165ebc85ca9a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:32.869645 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93ccd8ce-b105-4746-b31f-165ebc85ca9a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:33.013802 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-93ccd8ce-b105-4746-b31f-165ebc85ca9a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 22582 microversion: 2.20 time: 0.156834 Jul 30 16:08:33.015509 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 139/276] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:32 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 22582 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:08:33.024742 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-20a03e8e-16cd-4519-a241-ed28b066ff6a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 22433 microversion: 2.1 time: 0.225103 Jul 30 16:08:33.026403 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 138/277] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:32 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 22433 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:08:33.211718 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-39a9b1fe-1e08-46b4-8871-6a8d4944cf02 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:33.212515 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-39a9b1fe-1e08-46b4-8871-6a8d4944cf02 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:33.221196 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-39a9b1fe-1e08-46b4-8871-6a8d4944cf02 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:33.222010 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-39a9b1fe-1e08-46b4-8871-6a8d4944cf02 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:33.223341 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-39a9b1fe-1e08-46b4-8871-6a8d4944cf02 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:33.223902 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-39a9b1fe-1e08-46b4-8871-6a8d4944cf02 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:33.276534 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9cd8e951-24f8-4e57-a02a-1616ee40a3c7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:33.277372 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9cd8e951-24f8-4e57-a02a-1616ee40a3c7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:33.285165 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9cd8e951-24f8-4e57-a02a-1616ee40a3c7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:33.285890 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9cd8e951-24f8-4e57-a02a-1616ee40a3c7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:33.286799 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9cd8e951-24f8-4e57-a02a-1616ee40a3c7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:33.287404 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9cd8e951-24f8-4e57-a02a-1616ee40a3c7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:33.371536 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-39a9b1fe-1e08-46b4-8871-6a8d4944cf02 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:33.381181 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-39a9b1fe-1e08-46b4-8871-6a8d4944cf02 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.173703 Jul 30 16:08:33.382020 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 140/278] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:33 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:33.448831 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9cd8e951-24f8-4e57-a02a-1616ee40a3c7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:33.456751 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9cd8e951-24f8-4e57-a02a-1616ee40a3c7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1317 microversion: 2.1 time: 0.185859 Jul 30 16:08:33.457309 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 139/279] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:33 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:34.026578 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4a951353-af41-461c-9a12-0a408b60ab50 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:34.027522 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4a951353-af41-461c-9a12-0a408b60ab50 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:34.033902 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4a951353-af41-461c-9a12-0a408b60ab50 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:34.034350 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4a951353-af41-461c-9a12-0a408b60ab50 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:34.035121 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4a951353-af41-461c-9a12-0a408b60ab50 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:34.035582 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4a951353-af41-461c-9a12-0a408b60ab50 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:34.037252 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-96198f9c-a00e-4852-8851-2bda5a5ce15f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:34.038100 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-96198f9c-a00e-4852-8851-2bda5a5ce15f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:34.043870 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-96198f9c-a00e-4852-8851-2bda5a5ce15f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:34.044324 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-96198f9c-a00e-4852-8851-2bda5a5ce15f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:34.045099 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-96198f9c-a00e-4852-8851-2bda5a5ce15f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:34.045554 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-96198f9c-a00e-4852-8851-2bda5a5ce15f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:34.126152 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4a951353-af41-461c-9a12-0a408b60ab50 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 23030 microversion: 2.20 time: 0.103236 Jul 30 16:08:34.126774 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 141/280] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:34 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 23030 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:08:34.136847 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-96198f9c-a00e-4852-8851-2bda5a5ce15f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 23035 microversion: 2.1 time: 0.103154 Jul 30 16:08:34.137486 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 140/281] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:34 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 23035 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:08:34.398675 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-95eaee02-84ff-4c9d-92e2-ebd43dfa9117 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:34.399415 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-95eaee02-84ff-4c9d-92e2-ebd43dfa9117 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:34.405781 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95eaee02-84ff-4c9d-92e2-ebd43dfa9117 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:34.406222 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95eaee02-84ff-4c9d-92e2-ebd43dfa9117 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:34.406977 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95eaee02-84ff-4c9d-92e2-ebd43dfa9117 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:34.407434 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95eaee02-84ff-4c9d-92e2-ebd43dfa9117 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:34.472932 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-051d1805-aa27-4865-9d5c-f785ff277525 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:34.473983 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-051d1805-aa27-4865-9d5c-f785ff277525 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:34.480581 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-051d1805-aa27-4865-9d5c-f785ff277525 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:34.481150 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-051d1805-aa27-4865-9d5c-f785ff277525 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:34.482014 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-051d1805-aa27-4865-9d5c-f785ff277525 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:34.482525 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-051d1805-aa27-4865-9d5c-f785ff277525 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:34.533443 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-95eaee02-84ff-4c9d-92e2-ebd43dfa9117 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:34.543292 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-95eaee02-84ff-4c9d-92e2-ebd43dfa9117 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.148630 Jul 30 16:08:34.543872 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 142/282] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:34 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:34.615430 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-051d1805-aa27-4865-9d5c-f785ff277525 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:34.623902 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-051d1805-aa27-4865-9d5c-f785ff277525 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1317 microversion: 2.1 time: 0.154942 Jul 30 16:08:34.625051 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 141/283] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:34 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:35.138678 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-87745cf7-13ca-406d-b21c-861efea64b1d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:35.139842 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-87745cf7-13ca-406d-b21c-861efea64b1d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:35.149245 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-87745cf7-13ca-406d-b21c-861efea64b1d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:35.149878 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-87745cf7-13ca-406d-b21c-861efea64b1d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:35.150664 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-87745cf7-13ca-406d-b21c-861efea64b1d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:35.151101 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-87745cf7-13ca-406d-b21c-861efea64b1d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:35.151977 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-59061e62-b3e3-4a6c-b652-71e54b522d41 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:35.154207 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-59061e62-b3e3-4a6c-b652-71e54b522d41 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:35.163022 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59061e62-b3e3-4a6c-b652-71e54b522d41 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:35.163553 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59061e62-b3e3-4a6c-b652-71e54b522d41 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:35.164323 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59061e62-b3e3-4a6c-b652-71e54b522d41 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:35.164799 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59061e62-b3e3-4a6c-b652-71e54b522d41 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:35.265527 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-87745cf7-13ca-406d-b21c-861efea64b1d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 23218 microversion: 2.20 time: 0.129989 Jul 30 16:08:35.266951 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 143/284] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:35 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 23218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:08:35.282840 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-59061e62-b3e3-4a6c-b652-71e54b522d41 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 23225 microversion: 2.1 time: 0.134334 Jul 30 16:08:35.283708 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 142/285] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:35 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 23225 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:08:35.560626 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9bb64ba1-d840-4426-9afb-51641163856a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:35.561343 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9bb64ba1-d840-4426-9afb-51641163856a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:35.567819 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9bb64ba1-d840-4426-9afb-51641163856a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:35.568262 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9bb64ba1-d840-4426-9afb-51641163856a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:35.569032 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9bb64ba1-d840-4426-9afb-51641163856a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:35.569460 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9bb64ba1-d840-4426-9afb-51641163856a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:35.641802 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0c90ebda-f688-45d2-a62d-8f9509cc86b9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:35.642645 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0c90ebda-f688-45d2-a62d-8f9509cc86b9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:35.649502 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0c90ebda-f688-45d2-a62d-8f9509cc86b9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:35.650205 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0c90ebda-f688-45d2-a62d-8f9509cc86b9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:35.651326 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0c90ebda-f688-45d2-a62d-8f9509cc86b9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:35.651830 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0c90ebda-f688-45d2-a62d-8f9509cc86b9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:35.709858 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9bb64ba1-d840-4426-9afb-51641163856a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:35.719519 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9bb64ba1-d840-4426-9afb-51641163856a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.162823 Jul 30 16:08:35.721001 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 144/286] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:35 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:35.802130 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0c90ebda-f688-45d2-a62d-8f9509cc86b9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:35.809606 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0c90ebda-f688-45d2-a62d-8f9509cc86b9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1508 microversion: 2.1 time: 0.172809 Jul 30 16:08:35.810166 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 143/287] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:35 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:36.277441 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c81b4d86-71e3-456c-afca-7a19c593466f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:36.278416 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c81b4d86-71e3-456c-afca-7a19c593466f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:36.286704 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c81b4d86-71e3-456c-afca-7a19c593466f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:36.287409 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c81b4d86-71e3-456c-afca-7a19c593466f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:36.288660 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c81b4d86-71e3-456c-afca-7a19c593466f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:36.289022 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c81b4d86-71e3-456c-afca-7a19c593466f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:36.296968 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a1da3c8f-b502-49fe-88bb-065f88a1955f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:36.298720 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a1da3c8f-b502-49fe-88bb-065f88a1955f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:36.306317 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a1da3c8f-b502-49fe-88bb-065f88a1955f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:36.306781 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a1da3c8f-b502-49fe-88bb-065f88a1955f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:36.307780 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a1da3c8f-b502-49fe-88bb-065f88a1955f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:36.308273 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a1da3c8f-b502-49fe-88bb-065f88a1955f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:39.284610 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c81b4d86-71e3-456c-afca-7a19c593466f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 26111 microversion: 2.20 time: 3.010996 Jul 30 16:08:39.285374 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 145/288] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:36 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 26111 bytes in 3013 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:08:39.292754 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1546da4d-45b6-4c95-b048-d730eb689933 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:39.293583 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1546da4d-45b6-4c95-b048-d730eb689933 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:39.300760 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1546da4d-45b6-4c95-b048-d730eb689933 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:39.301236 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1546da4d-45b6-4c95-b048-d730eb689933 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:39.302017 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1546da4d-45b6-4c95-b048-d730eb689933 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:39.302451 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1546da4d-45b6-4c95-b048-d730eb689933 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:39.310991 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a1da3c8f-b502-49fe-88bb-065f88a1955f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 25832 microversion: 2.1 time: 3.017700 Jul 30 16:08:39.312535 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 144/289] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:36 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 25832 bytes in 3020 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:08:39.424641 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1546da4d-45b6-4c95-b048-d730eb689933 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:39.431826 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1546da4d-45b6-4c95-b048-d730eb689933 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.145057 Jul 30 16:08:39.432434 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 146/290] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:39 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:40.296428 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-583638b3-8f6f-4276-8fb3-788212e857d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:40.297609 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-583638b3-8f6f-4276-8fb3-788212e857d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:40.304399 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-583638b3-8f6f-4276-8fb3-788212e857d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:40.304871 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-583638b3-8f6f-4276-8fb3-788212e857d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:40.305645 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-583638b3-8f6f-4276-8fb3-788212e857d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:40.306079 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-583638b3-8f6f-4276-8fb3-788212e857d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:40.323410 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-11c16da7-3f75-45b7-8a49-c891e484f039 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:40.324362 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-11c16da7-3f75-45b7-8a49-c891e484f039 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:40.331070 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-11c16da7-3f75-45b7-8a49-c891e484f039 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:40.331548 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-11c16da7-3f75-45b7-8a49-c891e484f039 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:40.332304 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-11c16da7-3f75-45b7-8a49-c891e484f039 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:40.332804 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-11c16da7-3f75-45b7-8a49-c891e484f039 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:40.450139 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-583638b3-8f6f-4276-8fb3-788212e857d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 26546 microversion: 2.20 time: 0.157775 Jul 30 16:08:40.450855 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 145/291] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:40 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 26546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:08:40.457563 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3cbdc9fa-79d4-41cf-a2e5-bd9f15e51ffb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17ee5861-c1d7-4982-ab8f-0e2a428ed069"}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:40.458607 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-11c16da7-3f75-45b7-8a49-c891e484f039 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 26333 microversion: 2.1 time: 0.138824 Jul 30 16:08:40.458991 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3cbdc9fa-79d4-41cf-a2e5-bd9f15e51ffb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:40.459274 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 147/292] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:40 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 26333 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:08:40.464037 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-37010e1f-e054-4120-b527-7e01b0af1e70 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:40.464729 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-37010e1f-e054-4120-b527-7e01b0af1e70 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:40.465316 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3cbdc9fa-79d4-41cf-a2e5-bd9f15e51ffb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:40.465848 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3cbdc9fa-79d4-41cf-a2e5-bd9f15e51ffb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:40.466616 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3cbdc9fa-79d4-41cf-a2e5-bd9f15e51ffb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:40.467055 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3cbdc9fa-79d4-41cf-a2e5-bd9f15e51ffb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:40.471593 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-37010e1f-e054-4120-b527-7e01b0af1e70 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:40.471980 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-37010e1f-e054-4120-b527-7e01b0af1e70 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:40.472775 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-37010e1f-e054-4120-b527-7e01b0af1e70 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:40.473218 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-37010e1f-e054-4120-b527-7e01b0af1e70 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:40.605326 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-37010e1f-e054-4120-b527-7e01b0af1e70 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:40.621660 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-37010e1f-e054-4120-b527-7e01b0af1e70 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.161160 Jul 30 16:08:40.622406 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 148/293] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:40 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:40.766231 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3cbdc9fa-79d4-41cf-a2e5-bd9f15e51ffb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "POST /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313725 Jul 30 16:08:40.767456 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 146/294] 10.222.0.37 () {60 vars in 1323 bytes} [Fri Jul 30 16:08:40 2021] POST /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:08:41.461571 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8e9ca889-bed7-4327-a20e-c161f8cf02a3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:41.462479 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-8e9ca889-bed7-4327-a20e-c161f8cf02a3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:41.469140 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8e9ca889-bed7-4327-a20e-c161f8cf02a3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:41.469591 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8e9ca889-bed7-4327-a20e-c161f8cf02a3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:41.470359 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8e9ca889-bed7-4327-a20e-c161f8cf02a3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:41.470788 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8e9ca889-bed7-4327-a20e-c161f8cf02a3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:41.471490 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a80c9fdf-41fb-4e60-8dbd-9d85bb9d1ad0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:41.472548 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a80c9fdf-41fb-4e60-8dbd-9d85bb9d1ad0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:41.478481 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a80c9fdf-41fb-4e60-8dbd-9d85bb9d1ad0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:41.478928 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a80c9fdf-41fb-4e60-8dbd-9d85bb9d1ad0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:41.479724 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a80c9fdf-41fb-4e60-8dbd-9d85bb9d1ad0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:41.480158 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a80c9fdf-41fb-4e60-8dbd-9d85bb9d1ad0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:45.410545 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8e9ca889-bed7-4327-a20e-c161f8cf02a3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 27588 microversion: 2.20 time: 3.952444 Jul 30 16:08:45.411252 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 149/295] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:41 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 27588 bytes in 3954 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:08:45.416054 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-33570bfb-ef20-4d93-9607-9df0dacb59b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:45.416772 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-33570bfb-ef20-4d93-9607-9df0dacb59b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:45.423042 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-33570bfb-ef20-4d93-9607-9df0dacb59b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:45.423549 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-33570bfb-ef20-4d93-9607-9df0dacb59b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:45.424331 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-33570bfb-ef20-4d93-9607-9df0dacb59b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:45.424745 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-33570bfb-ef20-4d93-9607-9df0dacb59b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:45.460110 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a80c9fdf-41fb-4e60-8dbd-9d85bb9d1ad0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 27657 microversion: 2.1 time: 3.992478 Jul 30 16:08:45.460799 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 147/296] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:41 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 27657 bytes in 3994 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:08:45.560346 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-33570bfb-ef20-4d93-9607-9df0dacb59b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:45.568223 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-33570bfb-ef20-4d93-9607-9df0dacb59b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1522 microversion: 2.1 time: 0.155777 Jul 30 16:08:45.568783 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 150/297] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:45 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:46.422887 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-cedeb3cb-3331-4abf-a1ff-3d7600893de5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:46.424379 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-cedeb3cb-3331-4abf-a1ff-3d7600893de5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:46.431979 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cedeb3cb-3331-4abf-a1ff-3d7600893de5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:46.432436 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cedeb3cb-3331-4abf-a1ff-3d7600893de5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:46.433291 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cedeb3cb-3331-4abf-a1ff-3d7600893de5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:46.433852 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cedeb3cb-3331-4abf-a1ff-3d7600893de5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:46.473793 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-472afdb9-037d-44d9-81c7-420a71935d8d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:46.475393 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-472afdb9-037d-44d9-81c7-420a71935d8d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:46.481559 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-472afdb9-037d-44d9-81c7-420a71935d8d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:46.482002 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-472afdb9-037d-44d9-81c7-420a71935d8d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:46.482781 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-472afdb9-037d-44d9-81c7-420a71935d8d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:46.483285 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-472afdb9-037d-44d9-81c7-420a71935d8d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:46.548948 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-cedeb3cb-3331-4abf-a1ff-3d7600893de5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 27779 microversion: 2.20 time: 0.130530 Jul 30 16:08:46.549577 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 148/298] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:46 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 27779 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:08:46.587116 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6898bb8c-d306-406f-b26a-6ca339396097 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:46.587917 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6898bb8c-d306-406f-b26a-6ca339396097 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:46.594098 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-472afdb9-037d-44d9-81c7-420a71935d8d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 27791 microversion: 2.1 time: 0.124851 Jul 30 16:08:46.598264 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 151/299] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:46 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 27791 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:08:46.599536 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6898bb8c-d306-406f-b26a-6ca339396097 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:46.600039 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6898bb8c-d306-406f-b26a-6ca339396097 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:46.600771 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6898bb8c-d306-406f-b26a-6ca339396097 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:46.601209 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6898bb8c-d306-406f-b26a-6ca339396097 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:46.773734 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6898bb8c-d306-406f-b26a-6ca339396097 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:46.782016 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6898bb8c-d306-406f-b26a-6ca339396097 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1502 microversion: 2.1 time: 0.199144 Jul 30 16:08:46.783041 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 149/300] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:46 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1502 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:08:46.798562 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9952cd12-7373-4929-bb75-4aa7d25099af tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:46.799289 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9952cd12-7373-4929-bb75-4aa7d25099af tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:46.805641 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9952cd12-7373-4929-bb75-4aa7d25099af tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:46.806089 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9952cd12-7373-4929-bb75-4aa7d25099af tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:46.806861 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9952cd12-7373-4929-bb75-4aa7d25099af tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:46.807331 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9952cd12-7373-4929-bb75-4aa7d25099af tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:46.929016 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9952cd12-7373-4929-bb75-4aa7d25099af tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:46.936828 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9952cd12-7373-4929-bb75-4aa7d25099af tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1515 microversion: 2.1 time: 0.141885 Jul 30 16:08:46.937512 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 152/301] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:46 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1515 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:47.560320 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-7ddb0f99-fd6c-49a7-8bf2-386472054b93 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:47.562325 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7ddb0f99-fd6c-49a7-8bf2-386472054b93 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:47.568509 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7ddb0f99-fd6c-49a7-8bf2-386472054b93 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:47.568960 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7ddb0f99-fd6c-49a7-8bf2-386472054b93 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:47.569924 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7ddb0f99-fd6c-49a7-8bf2-386472054b93 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:47.570361 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7ddb0f99-fd6c-49a7-8bf2-386472054b93 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:47.605869 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-6860f269-049c-4a08-8a3c-92fb921e417d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:47.606898 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-6860f269-049c-4a08-8a3c-92fb921e417d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:47.613633 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6860f269-049c-4a08-8a3c-92fb921e417d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:47.613633 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6860f269-049c-4a08-8a3c-92fb921e417d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:47.614240 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6860f269-049c-4a08-8a3c-92fb921e417d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:47.614678 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6860f269-049c-4a08-8a3c-92fb921e417d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:50.496405 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-7ddb0f99-fd6c-49a7-8bf2-386472054b93 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 27921 microversion: 2.20 time: 2.939528 Jul 30 16:08:50.497096 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 150/302] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:47 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 27921 bytes in 2941 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:08:50.519718 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-6860f269-049c-4a08-8a3c-92fb921e417d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 27916 microversion: 2.1 time: 2.917353 Jul 30 16:08:50.520342 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 153/303] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:47 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 27916 bytes in 2919 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:08:51.508157 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1d4c88f8-9c5e-467c-aaeb-c9fb51e4bc72 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:51.509190 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1d4c88f8-9c5e-467c-aaeb-c9fb51e4bc72 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:51.515660 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1d4c88f8-9c5e-467c-aaeb-c9fb51e4bc72 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:51.516112 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1d4c88f8-9c5e-467c-aaeb-c9fb51e4bc72 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:51.516886 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1d4c88f8-9c5e-467c-aaeb-c9fb51e4bc72 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:51.517321 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1d4c88f8-9c5e-467c-aaeb-c9fb51e4bc72 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:51.531168 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-bdc408cd-a1e4-4a58-a275-ddd5d34559e8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:51.532734 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-bdc408cd-a1e4-4a58-a275-ddd5d34559e8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:51.539480 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bdc408cd-a1e4-4a58-a275-ddd5d34559e8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:51.540161 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bdc408cd-a1e4-4a58-a275-ddd5d34559e8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:51.540938 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bdc408cd-a1e4-4a58-a275-ddd5d34559e8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:51.541372 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bdc408cd-a1e4-4a58-a275-ddd5d34559e8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:55.465722 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1d4c88f8-9c5e-467c-aaeb-c9fb51e4bc72 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28151 microversion: 2.20 time: 3.961318 Jul 30 16:08:55.466610 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 151/304] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:51 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28151 bytes in 3963 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:08:55.481565 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-bdc408cd-a1e4-4a58-a275-ddd5d34559e8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28143 microversion: 2.1 time: 3.954738 Jul 30 16:08:55.482756 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 154/305] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:51 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28143 bytes in 3956 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:08:56.477850 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-27c1c9c6-acdd-4706-b092-ed3d0c9f0e55 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:56.478849 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-27c1c9c6-acdd-4706-b092-ed3d0c9f0e55 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:56.485644 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-27c1c9c6-acdd-4706-b092-ed3d0c9f0e55 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:56.486121 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-27c1c9c6-acdd-4706-b092-ed3d0c9f0e55 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:56.486919 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-27c1c9c6-acdd-4706-b092-ed3d0c9f0e55 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:56.487382 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-27c1c9c6-acdd-4706-b092-ed3d0c9f0e55 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:56.495266 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-83a3d1b4-4834-430d-9f23-ebcba8a7dc36 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:56.497104 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-83a3d1b4-4834-430d-9f23-ebcba8a7dc36 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:56.505639 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-83a3d1b4-4834-430d-9f23-ebcba8a7dc36 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:56.506459 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-83a3d1b4-4834-430d-9f23-ebcba8a7dc36 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:56.507449 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-83a3d1b4-4834-430d-9f23-ebcba8a7dc36 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:56.507879 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-83a3d1b4-4834-430d-9f23-ebcba8a7dc36 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:56.589415 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-27c1c9c6-acdd-4706-b092-ed3d0c9f0e55 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28151 microversion: 2.20 time: 0.115398 Jul 30 16:08:56.593288 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 152/306] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:56 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28151 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:08:56.606431 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-83a3d1b4-4834-430d-9f23-ebcba8a7dc36 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28208 microversion: 2.1 time: 0.115912 Jul 30 16:08:56.607190 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 155/307] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:56 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28208 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:08:56.769236 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-91399bfb-c988-4654-9a74-f227bf8868b6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:56.770266 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-91399bfb-c988-4654-9a74-f227bf8868b6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:56.777379 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-91399bfb-c988-4654-9a74-f227bf8868b6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:56.777779 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-91399bfb-c988-4654-9a74-f227bf8868b6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:56.778577 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-91399bfb-c988-4654-9a74-f227bf8868b6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:56.778985 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-91399bfb-c988-4654-9a74-f227bf8868b6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:56.805597 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.objects.instance [None req-91399bfb-c988-4654-9a74-f227bf8868b6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lazy-loading 'flavor' on Instance uuid f429942e-bf01-4d55-9cb0-29cdf5d6fef6 {{(pid=107452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:08:56.922723 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-91399bfb-c988-4654-9a74-f227bf8868b6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "POST /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6/action" status: 200 len: 32 microversion: 2.1 time: 0.158200 Jul 30 16:08:56.923594 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 153/308] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:56 2021] POST /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:08:56.932498 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0e04e19a-4cc7-4b72-b3d8-c0d0daacc72a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:56.933190 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0e04e19a-4cc7-4b72-b3d8-c0d0daacc72a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:56.940299 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0e04e19a-4cc7-4b72-b3d8-c0d0daacc72a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:56.940744 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0e04e19a-4cc7-4b72-b3d8-c0d0daacc72a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:56.941523 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0e04e19a-4cc7-4b72-b3d8-c0d0daacc72a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:56.941953 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0e04e19a-4cc7-4b72-b3d8-c0d0daacc72a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:57.093888 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0e04e19a-4cc7-4b72-b3d8-c0d0daacc72a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:57.101776 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0e04e19a-4cc7-4b72-b3d8-c0d0daacc72a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.173181 Jul 30 16:08:57.102337 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 156/309] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:56 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:57.602611 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-08b8d6f7-9013-4826-8fbd-db9474dbcea1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:57.603623 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-08b8d6f7-9013-4826-8fbd-db9474dbcea1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:57.610967 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-08b8d6f7-9013-4826-8fbd-db9474dbcea1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:57.611650 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-08b8d6f7-9013-4826-8fbd-db9474dbcea1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:57.612428 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-08b8d6f7-9013-4826-8fbd-db9474dbcea1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:57.612866 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-08b8d6f7-9013-4826-8fbd-db9474dbcea1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:57.618530 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-93a8d016-3cef-444b-995d-33c4ce003c38 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:57.619463 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-93a8d016-3cef-444b-995d-33c4ce003c38 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:57.625478 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93a8d016-3cef-444b-995d-33c4ce003c38 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:57.625924 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93a8d016-3cef-444b-995d-33c4ce003c38 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:57.626764 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93a8d016-3cef-444b-995d-33c4ce003c38 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:57.627430 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93a8d016-3cef-444b-995d-33c4ce003c38 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:57.705709 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-08b8d6f7-9013-4826-8fbd-db9474dbcea1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28151 microversion: 2.20 time: 0.106890 Jul 30 16:08:57.706550 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 154/310] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:57 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28151 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:08:57.716995 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-93a8d016-3cef-444b-995d-33c4ce003c38 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28208 microversion: 2.1 time: 0.102232 Jul 30 16:08:57.721445 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 157/311] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:57 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28208 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:08:57.885062 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-5fd75964-c5da-45a9-8faa-bc9c7cc95a93 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1817920471", "imageRef": "eea29a7d-10c3-489a-adee-10be2e7a26bd", "flavorRef": "452", "networks": [{"uuid": "9a836950-de83-4064-be6b-b98de3093a5e"}]}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:57.938188 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.network.neutron [None req-5fd75964-c5da-45a9-8faa-bc9c7cc95a93 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] validate_networks() for [('9a836950-de83-4064-be6b-b98de3093a5e', None, None, None)] {{(pid=107452) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:08:58.119885 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a634759b-8a9c-47bf-96da-5d37dbe2ee38 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:58.120631 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a634759b-8a9c-47bf-96da-5d37dbe2ee38 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:58.127113 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a634759b-8a9c-47bf-96da-5d37dbe2ee38 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:58.127592 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a634759b-8a9c-47bf-96da-5d37dbe2ee38 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:58.128356 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a634759b-8a9c-47bf-96da-5d37dbe2ee38 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:58.128830 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a634759b-8a9c-47bf-96da-5d37dbe2ee38 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:58.257999 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a634759b-8a9c-47bf-96da-5d37dbe2ee38 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:58.272454 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a634759b-8a9c-47bf-96da-5d37dbe2ee38 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.156424 Jul 30 16:08:58.273031 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 158/312] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:58 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:08:58.312318 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-5fd75964-c5da-45a9-8faa-bc9c7cc95a93 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Flavor limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:08:58.312885 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-5fd75964-c5da-45a9-8faa-bc9c7cc95a93 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Image limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:08:58.313559 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-5fd75964-c5da-45a9-8faa-bc9c7cc95a93 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Flavor pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:08:58.314168 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-5fd75964-c5da-45a9-8faa-bc9c7cc95a93 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Image pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:08:58.314845 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-5fd75964-c5da-45a9-8faa-bc9c7cc95a93 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:08:58.329139 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5fd75964-c5da-45a9-8faa-bc9c7cc95a93 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:58.329894 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5fd75964-c5da-45a9-8faa-bc9c7cc95a93 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:58.331282 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5fd75964-c5da-45a9-8faa-bc9c7cc95a93 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:58.332034 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5fd75964-c5da-45a9-8faa-bc9c7cc95a93 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:58.365126 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-5fd75964-c5da-45a9-8faa-bc9c7cc95a93 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Getting quotas for project e9b01b7e6d90426088cefd5ff16e7347. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:08:58.371291 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-5fd75964-c5da-45a9-8faa-bc9c7cc95a93 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Getting quotas for user 0f16217b495748478088d59006761959 and project e9b01b7e6d90426088cefd5ff16e7347. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:08:58.390955 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-5fd75964-c5da-45a9-8faa-bc9c7cc95a93 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Going to run 1 instances... {{(pid=107452) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:08:58.394585 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-5fd75964-c5da-45a9-8faa-bc9c7cc95a93 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eea29a7d-10c3-489a-adee-10be2e7a26bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:08:58.440675 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-5fd75964-c5da-45a9-8faa-bc9c7cc95a93 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559538 Jul 30 16:08:58.441371 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 155/313] 10.222.0.37 () {60 vars in 1147 bytes} [Fri Jul 30 16:08:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 16:08:58.450917 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-33b1cbbd-10d4-47dd-8aa7-f2914445e06a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:58.451550 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-33b1cbbd-10d4-47dd-8aa7-f2914445e06a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:58.502415 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-33b1cbbd-10d4-47dd-8aa7-f2914445e06a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:58.509620 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-33b1cbbd-10d4-47dd-8aa7-f2914445e06a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8" status: 200 len: 1218 microversion: 2.1 time: 0.062326 Jul 30 16:08:58.510179 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 159/314] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:58 2021] GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:08:58.717269 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e1c0c8cd-2d5c-44cf-8378-31b8cf09929c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:58.719097 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e1c0c8cd-2d5c-44cf-8378-31b8cf09929c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:58.726353 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e1c0c8cd-2d5c-44cf-8378-31b8cf09929c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:58.727026 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e1c0c8cd-2d5c-44cf-8378-31b8cf09929c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:58.728062 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e1c0c8cd-2d5c-44cf-8378-31b8cf09929c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:58.728641 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e1c0c8cd-2d5c-44cf-8378-31b8cf09929c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:58.731534 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-108b8693-a7a5-4213-ad0f-9f88130ba707 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:58.743333 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-108b8693-a7a5-4213-ad0f-9f88130ba707 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:58.751625 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-108b8693-a7a5-4213-ad0f-9f88130ba707 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:58.752083 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-108b8693-a7a5-4213-ad0f-9f88130ba707 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:58.752921 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-108b8693-a7a5-4213-ad0f-9f88130ba707 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:58.753594 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-108b8693-a7a5-4213-ad0f-9f88130ba707 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:58.847859 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e1c0c8cd-2d5c-44cf-8378-31b8cf09929c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28151 microversion: 2.20 time: 0.134093 Jul 30 16:08:58.848833 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 156/315] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:58 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28151 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:08:58.868663 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-108b8693-a7a5-4213-ad0f-9f88130ba707 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28208 microversion: 2.1 time: 0.142096 Jul 30 16:08:58.869362 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 160/316] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:58 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28208 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:08:59.290444 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-62fbdbbc-768a-4c6e-98b9-e71218466fe5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:59.291168 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-62fbdbbc-768a-4c6e-98b9-e71218466fe5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:59.298208 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-62fbdbbc-768a-4c6e-98b9-e71218466fe5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:59.298654 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-62fbdbbc-768a-4c6e-98b9-e71218466fe5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:59.299455 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-62fbdbbc-768a-4c6e-98b9-e71218466fe5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:59.299885 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-62fbdbbc-768a-4c6e-98b9-e71218466fe5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:59.422801 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-62fbdbbc-768a-4c6e-98b9-e71218466fe5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:59.430387 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-62fbdbbc-768a-4c6e-98b9-e71218466fe5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.144468 Jul 30 16:08:59.430955 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 157/317] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:59 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:59.528119 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f1181554-7768-48fb-b9e8-99089f71d2f7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:08:59.528905 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f1181554-7768-48fb-b9e8-99089f71d2f7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:59.535906 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f1181554-7768-48fb-b9e8-99089f71d2f7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:59.536353 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f1181554-7768-48fb-b9e8-99089f71d2f7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:59.537118 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f1181554-7768-48fb-b9e8-99089f71d2f7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:59.537549 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f1181554-7768-48fb-b9e8-99089f71d2f7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:59.600832 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f1181554-7768-48fb-b9e8-99089f71d2f7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:08:59.608190 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f1181554-7768-48fb-b9e8-99089f71d2f7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8" status: 200 len: 1270 microversion: 2.1 time: 0.084224 Jul 30 16:08:59.608754 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 161/318] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:08:59 2021] GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:08:59.861306 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6dcdff2e-4103-4769-805a-d05c65e4e571 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:59.862230 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6dcdff2e-4103-4769-805a-d05c65e4e571 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:59.868149 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6dcdff2e-4103-4769-805a-d05c65e4e571 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:59.868694 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6dcdff2e-4103-4769-805a-d05c65e4e571 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:59.869803 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6dcdff2e-4103-4769-805a-d05c65e4e571 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:59.870740 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6dcdff2e-4103-4769-805a-d05c65e4e571 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:59.885392 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-51037c27-8f29-4708-b2ea-8b9e09a098b5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:08:59.887356 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-51037c27-8f29-4708-b2ea-8b9e09a098b5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:08:59.903803 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-51037c27-8f29-4708-b2ea-8b9e09a098b5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:59.904601 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-51037c27-8f29-4708-b2ea-8b9e09a098b5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:59.906438 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-51037c27-8f29-4708-b2ea-8b9e09a098b5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:08:59.907100 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-51037c27-8f29-4708-b2ea-8b9e09a098b5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:08:59.988220 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6dcdff2e-4103-4769-805a-d05c65e4e571 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28151 microversion: 2.20 time: 0.131244 Jul 30 16:08:59.997871 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 158/319] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:08:59 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28151 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:00.043364 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-51037c27-8f29-4708-b2ea-8b9e09a098b5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28208 microversion: 2.1 time: 0.162073 Jul 30 16:09:00.044322 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 162/320] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:08:59 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28208 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:00.450102 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8a9f054b-7685-406b-98ff-3eb0fc096b2d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:00.450977 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8a9f054b-7685-406b-98ff-3eb0fc096b2d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:00.460781 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8a9f054b-7685-406b-98ff-3eb0fc096b2d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:00.461519 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8a9f054b-7685-406b-98ff-3eb0fc096b2d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:00.462769 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8a9f054b-7685-406b-98ff-3eb0fc096b2d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:00.463247 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8a9f054b-7685-406b-98ff-3eb0fc096b2d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:00.626256 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b057766c-6a07-4ccf-8cc6-55dc5c0b554f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:00.627219 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b057766c-6a07-4ccf-8cc6-55dc5c0b554f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:00.634138 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b057766c-6a07-4ccf-8cc6-55dc5c0b554f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:00.634787 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b057766c-6a07-4ccf-8cc6-55dc5c0b554f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:00.636035 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b057766c-6a07-4ccf-8cc6-55dc5c0b554f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:00.637169 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b057766c-6a07-4ccf-8cc6-55dc5c0b554f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:00.773670 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8a9f054b-7685-406b-98ff-3eb0fc096b2d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:00.783706 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8a9f054b-7685-406b-98ff-3eb0fc096b2d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.338608 Jul 30 16:09:00.792651 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b057766c-6a07-4ccf-8cc6-55dc5c0b554f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:00.793970 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 159/321] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:00 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:00.806467 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b057766c-6a07-4ccf-8cc6-55dc5c0b554f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8" status: 200 len: 1318 microversion: 2.1 time: 0.184912 Jul 30 16:09:00.807053 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 163/322] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:00 2021] GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:01.009381 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-579d90bc-3c7c-4021-a106-fafa07a9daf3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:01.010303 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-579d90bc-3c7c-4021-a106-fafa07a9daf3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:01.019097 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-579d90bc-3c7c-4021-a106-fafa07a9daf3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:01.019810 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-579d90bc-3c7c-4021-a106-fafa07a9daf3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:01.020781 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-579d90bc-3c7c-4021-a106-fafa07a9daf3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:01.021369 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-579d90bc-3c7c-4021-a106-fafa07a9daf3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:01.062560 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-cd89c028-8394-47b0-834a-8356292e0064 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:01.063537 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-cd89c028-8394-47b0-834a-8356292e0064 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:01.073323 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cd89c028-8394-47b0-834a-8356292e0064 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:01.073780 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cd89c028-8394-47b0-834a-8356292e0064 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:01.074567 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cd89c028-8394-47b0-834a-8356292e0064 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:01.075001 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cd89c028-8394-47b0-834a-8356292e0064 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:01.143953 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-579d90bc-3c7c-4021-a106-fafa07a9daf3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28151 microversion: 2.20 time: 0.136720 Jul 30 16:09:01.144797 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 160/323] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:01 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28151 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:01.217134 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-cd89c028-8394-47b0-834a-8356292e0064 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28208 microversion: 2.1 time: 0.165265 Jul 30 16:09:01.222193 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 164/324] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:01 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28208 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:01.332458 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-7ebbc14a-e6f3-4c41-9257-fcee2aba9a9a req-677fc99d-f8e5-4920-844c-8eb3bf1cc487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8", "tag": "93b5bd35-b14d-4747-b351-ad0f4291d3bf"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:01.333988 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:09:01.333988 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:09:01.347820 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-7ebbc14a-e6f3-4c41-9257-fcee2aba9a9a req-677fc99d-f8e5-4920-844c-8eb3bf1cc487 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:01.349532 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-7ebbc14a-e6f3-4c41-9257-fcee2aba9a9a req-677fc99d-f8e5-4920-844c-8eb3bf1cc487 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:01.390833 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-7ebbc14a-e6f3-4c41-9257-fcee2aba9a9a req-677fc99d-f8e5-4920-844c-8eb3bf1cc487 service nova] Creating event network-changed:93b5bd35-b14d-4747-b351-ad0f4291d3bf for instance fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 on hv-cinder-80304 Jul 30 16:09:01.403209 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-7ebbc14a-e6f3-4c41-9257-fcee2aba9a9a req-677fc99d-f8e5-4920-844c-8eb3bf1cc487 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074791 Jul 30 16:09:01.404113 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 161/325] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:09:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:09:01.811051 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f1ce0d91-0321-4f6c-af0b-7f3637c178fb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:01.812151 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f1ce0d91-0321-4f6c-af0b-7f3637c178fb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:01.819395 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f1ce0d91-0321-4f6c-af0b-7f3637c178fb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:01.819841 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f1ce0d91-0321-4f6c-af0b-7f3637c178fb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:01.820866 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f1ce0d91-0321-4f6c-af0b-7f3637c178fb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:01.821493 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f1ce0d91-0321-4f6c-af0b-7f3637c178fb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:01.824479 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-5af9f34a-d47e-468f-a70d-328d5d15136a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:01.827415 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-5af9f34a-d47e-468f-a70d-328d5d15136a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:01.835456 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5af9f34a-d47e-468f-a70d-328d5d15136a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:01.836581 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5af9f34a-d47e-468f-a70d-328d5d15136a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:01.838104 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5af9f34a-d47e-468f-a70d-328d5d15136a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:01.838757 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5af9f34a-d47e-468f-a70d-328d5d15136a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:01.968113 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f1ce0d91-0321-4f6c-af0b-7f3637c178fb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:01.975019 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f1ce0d91-0321-4f6c-af0b-7f3637c178fb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.173525 Jul 30 16:09:01.975793 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 165/326] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:01 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:02.106472 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-5af9f34a-d47e-468f-a70d-328d5d15136a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:02.123588 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-5af9f34a-d47e-468f-a70d-328d5d15136a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8" status: 200 len: 1318 microversion: 2.1 time: 0.299705 Jul 30 16:09:02.132245 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 162/327] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:01 2021] GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:02.158075 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-096a3b45-81b7-4d7e-ad42-5ee854c9cc28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:02.159152 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-096a3b45-81b7-4d7e-ad42-5ee854c9cc28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:02.165921 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-096a3b45-81b7-4d7e-ad42-5ee854c9cc28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:02.166631 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-096a3b45-81b7-4d7e-ad42-5ee854c9cc28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:02.167657 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-096a3b45-81b7-4d7e-ad42-5ee854c9cc28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:02.168572 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-096a3b45-81b7-4d7e-ad42-5ee854c9cc28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:02.229771 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-72d6d9e7-f33d-4ff6-b13d-1e76d416e1dd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:02.231036 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-72d6d9e7-f33d-4ff6-b13d-1e76d416e1dd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:02.239490 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-72d6d9e7-f33d-4ff6-b13d-1e76d416e1dd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:02.240173 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-72d6d9e7-f33d-4ff6-b13d-1e76d416e1dd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:02.241136 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-72d6d9e7-f33d-4ff6-b13d-1e76d416e1dd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:02.241685 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-72d6d9e7-f33d-4ff6-b13d-1e76d416e1dd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:02.295059 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-096a3b45-81b7-4d7e-ad42-5ee854c9cc28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28159 microversion: 2.20 time: 0.140064 Jul 30 16:09:02.296439 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 166/328] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:02 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28159 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:02.404760 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-72d6d9e7-f33d-4ff6-b13d-1e76d416e1dd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28223 microversion: 2.1 time: 0.178486 Jul 30 16:09:02.406565 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 163/329] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:02 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28223 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:09:02.992662 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ac299f6e-caa7-4322-9b39-2c222d15930e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:02.993347 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ac299f6e-caa7-4322-9b39-2c222d15930e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:03.000539 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ac299f6e-caa7-4322-9b39-2c222d15930e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:03.001022 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ac299f6e-caa7-4322-9b39-2c222d15930e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:03.001788 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ac299f6e-caa7-4322-9b39-2c222d15930e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:03.002268 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ac299f6e-caa7-4322-9b39-2c222d15930e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:03.128550 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ac299f6e-caa7-4322-9b39-2c222d15930e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:03.136258 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ac299f6e-caa7-4322-9b39-2c222d15930e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.147264 Jul 30 16:09:03.136823 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 167/330] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:02 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:03.144477 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9c5c122e-0135-47af-a40d-b4bff33e48ec tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:03.145196 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9c5c122e-0135-47af-a40d-b4bff33e48ec tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:03.151189 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9c5c122e-0135-47af-a40d-b4bff33e48ec tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:03.151637 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9c5c122e-0135-47af-a40d-b4bff33e48ec tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:03.152395 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9c5c122e-0135-47af-a40d-b4bff33e48ec tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:03.152823 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9c5c122e-0135-47af-a40d-b4bff33e48ec tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:03.278263 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9c5c122e-0135-47af-a40d-b4bff33e48ec tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:03.285626 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9c5c122e-0135-47af-a40d-b4bff33e48ec tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8" status: 200 len: 1318 microversion: 2.1 time: 0.148523 Jul 30 16:09:03.286192 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 164/331] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:03 2021] GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:09:03.309493 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-28e017ec-acdd-4cbf-9254-0417c3d0c398 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:03.310394 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-28e017ec-acdd-4cbf-9254-0417c3d0c398 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:03.316840 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-28e017ec-acdd-4cbf-9254-0417c3d0c398 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:03.317289 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-28e017ec-acdd-4cbf-9254-0417c3d0c398 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:03.318044 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-28e017ec-acdd-4cbf-9254-0417c3d0c398 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:03.318473 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-28e017ec-acdd-4cbf-9254-0417c3d0c398 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:03.417590 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-46a75c2d-5bd7-46a6-b26a-8b147ff49b16 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:03.418496 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-46a75c2d-5bd7-46a6-b26a-8b147ff49b16 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:03.424994 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-46a75c2d-5bd7-46a6-b26a-8b147ff49b16 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:03.425445 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-46a75c2d-5bd7-46a6-b26a-8b147ff49b16 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:03.426217 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-46a75c2d-5bd7-46a6-b26a-8b147ff49b16 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:03.426657 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-46a75c2d-5bd7-46a6-b26a-8b147ff49b16 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:03.432419 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-28e017ec-acdd-4cbf-9254-0417c3d0c398 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28432 microversion: 2.20 time: 0.126409 Jul 30 16:09:03.433904 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 168/332] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:03 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28432 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:09:03.577139 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-46a75c2d-5bd7-46a6-b26a-8b147ff49b16 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28469 microversion: 2.1 time: 0.162783 Jul 30 16:09:03.577756 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 165/333] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:03 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28469 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:09:04.153293 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-624ac3e0-57e9-4382-ba4e-99c1d9eb8795 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:04.153930 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-624ac3e0-57e9-4382-ba4e-99c1d9eb8795 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:04.160860 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-624ac3e0-57e9-4382-ba4e-99c1d9eb8795 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:04.161301 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-624ac3e0-57e9-4382-ba4e-99c1d9eb8795 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:04.162059 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-624ac3e0-57e9-4382-ba4e-99c1d9eb8795 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:04.162487 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-624ac3e0-57e9-4382-ba4e-99c1d9eb8795 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:04.293335 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-624ac3e0-57e9-4382-ba4e-99c1d9eb8795 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:04.303194 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8f6d34ab-29f0-4ef9-a010-b5b736a201a8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:04.303674 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-624ac3e0-57e9-4382-ba4e-99c1d9eb8795 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.154356 Jul 30 16:09:04.304222 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 169/334] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:04 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:04.304430 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8f6d34ab-29f0-4ef9-a010-b5b736a201a8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:04.312599 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f6d34ab-29f0-4ef9-a010-b5b736a201a8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:04.313090 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f6d34ab-29f0-4ef9-a010-b5b736a201a8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:04.314027 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f6d34ab-29f0-4ef9-a010-b5b736a201a8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:04.314549 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f6d34ab-29f0-4ef9-a010-b5b736a201a8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:04.443449 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8f6d34ab-29f0-4ef9-a010-b5b736a201a8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:04.444234 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-db4469bb-bf30-4f21-8e05-b61fabbbea9f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:04.445137 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-db4469bb-bf30-4f21-8e05-b61fabbbea9f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:04.450982 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-db4469bb-bf30-4f21-8e05-b61fabbbea9f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:04.451380 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-db4469bb-bf30-4f21-8e05-b61fabbbea9f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:04.451498 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8f6d34ab-29f0-4ef9-a010-b5b736a201a8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8" status: 200 len: 1318 microversion: 2.1 time: 0.152039 Jul 30 16:09:04.452744 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 166/335] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:04 2021] GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:09:04.453085 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-db4469bb-bf30-4f21-8e05-b61fabbbea9f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:04.453520 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-db4469bb-bf30-4f21-8e05-b61fabbbea9f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:04.554386 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-db4469bb-bf30-4f21-8e05-b61fabbbea9f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28434 microversion: 2.20 time: 0.113676 Jul 30 16:09:04.554928 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 170/336] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:04 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28434 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:09:04.588500 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-05e47572-7ae3-4b9e-9476-447be92340b5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:04.589413 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-05e47572-7ae3-4b9e-9476-447be92340b5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:04.595332 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-05e47572-7ae3-4b9e-9476-447be92340b5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:04.595783 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-05e47572-7ae3-4b9e-9476-447be92340b5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:04.596551 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-05e47572-7ae3-4b9e-9476-447be92340b5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:04.596989 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-05e47572-7ae3-4b9e-9476-447be92340b5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:04.722467 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-05e47572-7ae3-4b9e-9476-447be92340b5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28491 microversion: 2.1 time: 0.137410 Jul 30 16:09:04.723105 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 167/337] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:04 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28491 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:05.320371 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-64ea4126-5846-464f-8760-81380b099447 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:05.321063 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-64ea4126-5846-464f-8760-81380b099447 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:05.327552 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-64ea4126-5846-464f-8760-81380b099447 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:05.328008 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-64ea4126-5846-464f-8760-81380b099447 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:05.328776 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-64ea4126-5846-464f-8760-81380b099447 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:05.329218 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-64ea4126-5846-464f-8760-81380b099447 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:05.454868 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-64ea4126-5846-464f-8760-81380b099447 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:05.462197 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-64ea4126-5846-464f-8760-81380b099447 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.145889 Jul 30 16:09:05.462760 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 171/338] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:05 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:05.470198 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3c3c8a59-f536-4110-950d-9443cc3080dc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:05.471488 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3c3c8a59-f536-4110-950d-9443cc3080dc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:05.478191 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3c3c8a59-f536-4110-950d-9443cc3080dc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:05.478896 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3c3c8a59-f536-4110-950d-9443cc3080dc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:05.479840 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3c3c8a59-f536-4110-950d-9443cc3080dc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:05.480268 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3c3c8a59-f536-4110-950d-9443cc3080dc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:05.565824 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4b1f81d7-64c5-4d46-b1b5-07405f98488f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:05.566725 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4b1f81d7-64c5-4d46-b1b5-07405f98488f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:05.572620 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4b1f81d7-64c5-4d46-b1b5-07405f98488f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:05.573073 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4b1f81d7-64c5-4d46-b1b5-07405f98488f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:05.573839 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4b1f81d7-64c5-4d46-b1b5-07405f98488f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:05.574268 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4b1f81d7-64c5-4d46-b1b5-07405f98488f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:05.610054 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-3c3c8a59-f536-4110-950d-9443cc3080dc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:05.617325 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3c3c8a59-f536-4110-950d-9443cc3080dc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8" status: 200 len: 1318 microversion: 2.1 time: 0.151980 Jul 30 16:09:05.617870 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 168/339] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:05 2021] GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:09:05.680384 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4b1f81d7-64c5-4d46-b1b5-07405f98488f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28434 microversion: 2.20 time: 0.118027 Jul 30 16:09:05.681050 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 172/340] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:05 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28434 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:09:05.733341 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ae8f65e8-d8d7-4677-bb37-7de7855b6812 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:05.734344 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ae8f65e8-d8d7-4677-bb37-7de7855b6812 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:05.740662 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ae8f65e8-d8d7-4677-bb37-7de7855b6812 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:05.741190 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ae8f65e8-d8d7-4677-bb37-7de7855b6812 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:05.741984 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ae8f65e8-d8d7-4677-bb37-7de7855b6812 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:05.742415 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ae8f65e8-d8d7-4677-bb37-7de7855b6812 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:05.851026 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ae8f65e8-d8d7-4677-bb37-7de7855b6812 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28491 microversion: 2.1 time: 0.121241 Jul 30 16:09:05.851697 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 169/341] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:05 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28491 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:09:06.480005 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1e393cf8-f291-47b9-90f3-187b5cca9de0 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:06.481399 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1e393cf8-f291-47b9-90f3-187b5cca9de0 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:06.488063 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1e393cf8-f291-47b9-90f3-187b5cca9de0 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:06.488832 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1e393cf8-f291-47b9-90f3-187b5cca9de0 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:06.490044 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1e393cf8-f291-47b9-90f3-187b5cca9de0 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:06.491516 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1e393cf8-f291-47b9-90f3-187b5cca9de0 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:06.634187 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9a25447e-8d28-4c05-ba84-a134c9ae993a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:06.634981 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9a25447e-8d28-4c05-ba84-a134c9ae993a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:06.642423 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9a25447e-8d28-4c05-ba84-a134c9ae993a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:06.642966 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9a25447e-8d28-4c05-ba84-a134c9ae993a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:06.643771 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9a25447e-8d28-4c05-ba84-a134c9ae993a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:06.644205 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9a25447e-8d28-4c05-ba84-a134c9ae993a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:06.663483 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1e393cf8-f291-47b9-90f3-187b5cca9de0 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:06.672267 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1e393cf8-f291-47b9-90f3-187b5cca9de0 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.196732 Jul 30 16:09:06.672832 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 173/342] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:06 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:06.696640 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-7836bd32-131f-46f6-a752-8471f1b9dc33 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:06.697549 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-7836bd32-131f-46f6-a752-8471f1b9dc33 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:06.719123 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7836bd32-131f-46f6-a752-8471f1b9dc33 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:06.719507 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7836bd32-131f-46f6-a752-8471f1b9dc33 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:06.720289 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7836bd32-131f-46f6-a752-8471f1b9dc33 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:06.720885 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7836bd32-131f-46f6-a752-8471f1b9dc33 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:06.782704 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9a25447e-8d28-4c05-ba84-a134c9ae993a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:06.789888 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9a25447e-8d28-4c05-ba84-a134c9ae993a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8" status: 200 len: 1318 microversion: 2.1 time: 0.159724 Jul 30 16:09:06.790445 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 170/343] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:06 2021] GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:09:06.831978 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-7836bd32-131f-46f6-a752-8471f1b9dc33 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28434 microversion: 2.20 time: 0.141137 Jul 30 16:09:06.833476 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 174/344] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:06 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28434 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:06.862546 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-496f7ea9-5db1-40f3-8fb1-edea0976282a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:06.863576 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-496f7ea9-5db1-40f3-8fb1-edea0976282a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:06.869314 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-496f7ea9-5db1-40f3-8fb1-edea0976282a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:06.869755 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-496f7ea9-5db1-40f3-8fb1-edea0976282a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:06.870515 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-496f7ea9-5db1-40f3-8fb1-edea0976282a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:06.870947 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-496f7ea9-5db1-40f3-8fb1-edea0976282a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:06.970857 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-496f7ea9-5db1-40f3-8fb1-edea0976282a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28491 microversion: 2.1 time: 0.112419 Jul 30 16:09:06.971534 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 171/345] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:06 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28491 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:07.690440 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ea877611-5a20-40e3-9fbf-a4cfd3099f06 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:07.691294 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ea877611-5a20-40e3-9fbf-a4cfd3099f06 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:07.698481 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ea877611-5a20-40e3-9fbf-a4cfd3099f06 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:07.699283 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ea877611-5a20-40e3-9fbf-a4cfd3099f06 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:07.700375 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ea877611-5a20-40e3-9fbf-a4cfd3099f06 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:07.700955 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ea877611-5a20-40e3-9fbf-a4cfd3099f06 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:07.806682 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-975eb68c-e090-4888-8f8c-1dd35622c5a5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:07.807598 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-975eb68c-e090-4888-8f8c-1dd35622c5a5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:07.817748 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-975eb68c-e090-4888-8f8c-1dd35622c5a5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:07.818223 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-975eb68c-e090-4888-8f8c-1dd35622c5a5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:07.818984 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-975eb68c-e090-4888-8f8c-1dd35622c5a5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:07.819458 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-975eb68c-e090-4888-8f8c-1dd35622c5a5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:07.852032 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ea877611-5a20-40e3-9fbf-a4cfd3099f06 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:07.859715 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ea877611-5a20-40e3-9fbf-a4cfd3099f06 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.174191 Jul 30 16:09:07.860273 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 175/346] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:07 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:07.867002 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-284adf57-930c-47ac-b489-5ebaaf21ddbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:07.867970 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-284adf57-930c-47ac-b489-5ebaaf21ddbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:07.874150 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-284adf57-930c-47ac-b489-5ebaaf21ddbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:07.874542 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-284adf57-930c-47ac-b489-5ebaaf21ddbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:07.875354 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-284adf57-930c-47ac-b489-5ebaaf21ddbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:07.875793 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-284adf57-930c-47ac-b489-5ebaaf21ddbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:07.986006 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-284adf57-930c-47ac-b489-5ebaaf21ddbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28599 microversion: 2.20 time: 0.124434 Jul 30 16:09:07.987166 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 176/347] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:07 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28599 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:07.994302 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a200ac39-1352-4655-bc1a-353f7bc458ab tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:07.995324 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a200ac39-1352-4655-bc1a-353f7bc458ab tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:08.002642 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a200ac39-1352-4655-bc1a-353f7bc458ab tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:08.003094 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a200ac39-1352-4655-bc1a-353f7bc458ab tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:08.003907 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a200ac39-1352-4655-bc1a-353f7bc458ab tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:08.004338 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a200ac39-1352-4655-bc1a-353f7bc458ab tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:08.043209 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-975eb68c-e090-4888-8f8c-1dd35622c5a5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:08.051634 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-975eb68c-e090-4888-8f8c-1dd35622c5a5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8" status: 200 len: 1318 microversion: 2.1 time: 0.249001 Jul 30 16:09:08.052229 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 172/348] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:07 2021] GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:09:08.112084 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a200ac39-1352-4655-bc1a-353f7bc458ab tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28646 microversion: 2.1 time: 0.123485 Jul 30 16:09:08.112800 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 177/349] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:07 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28646 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:08.877684 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d9daabeb-d6bb-4463-9e8b-56cec2604f94 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:08.878336 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d9daabeb-d6bb-4463-9e8b-56cec2604f94 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:08.884584 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d9daabeb-d6bb-4463-9e8b-56cec2604f94 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:08.885037 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d9daabeb-d6bb-4463-9e8b-56cec2604f94 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:08.885810 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d9daabeb-d6bb-4463-9e8b-56cec2604f94 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:08.886248 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d9daabeb-d6bb-4463-9e8b-56cec2604f94 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:09.001369 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4e0e82ec-436b-411f-a636-ec61393951ff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:09.002384 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4e0e82ec-436b-411f-a636-ec61393951ff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:09.010491 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4e0e82ec-436b-411f-a636-ec61393951ff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:09.015650 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d9daabeb-d6bb-4463-9e8b-56cec2604f94 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:09.018871 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4e0e82ec-436b-411f-a636-ec61393951ff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:09.023110 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d9daabeb-d6bb-4463-9e8b-56cec2604f94 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.150499 Jul 30 16:09:09.023697 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 173/350] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:08 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:09.024566 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4e0e82ec-436b-411f-a636-ec61393951ff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:09.025018 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4e0e82ec-436b-411f-a636-ec61393951ff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:09.040387 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-8b90e87d-b2c5-4d22-a5ad-37b876947706 req-4be31d40-0dbd-48a0-a44e-b9722bf168ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8", "name": "network-vif-plugged", "status": "completed", "tag": "93b5bd35-b14d-4747-b351-ad0f4291d3bf"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:09.042037 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:09:09.042037 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:09:09.049863 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-8b90e87d-b2c5-4d22-a5ad-37b876947706 req-4be31d40-0dbd-48a0-a44e-b9722bf168ec service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:09.050383 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-8b90e87d-b2c5-4d22-a5ad-37b876947706 req-4be31d40-0dbd-48a0-a44e-b9722bf168ec service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:09.064448 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-8b90e87d-b2c5-4d22-a5ad-37b876947706 req-4be31d40-0dbd-48a0-a44e-b9722bf168ec service nova] Creating event network-vif-plugged:93b5bd35-b14d-4747-b351-ad0f4291d3bf for instance fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 on hv-cinder-80304 Jul 30 16:09:09.069104 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-8b90e87d-b2c5-4d22-a5ad-37b876947706 req-4be31d40-0dbd-48a0-a44e-b9722bf168ec service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032281 Jul 30 16:09:09.069884 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 174/351] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:09:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:09:09.074763 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0ac75c2b-1006-49f8-9c41-936be855adc4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:09.075482 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0ac75c2b-1006-49f8-9c41-936be855adc4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:09.081371 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0ac75c2b-1006-49f8-9c41-936be855adc4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:09.081819 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0ac75c2b-1006-49f8-9c41-936be855adc4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:09.082586 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0ac75c2b-1006-49f8-9c41-936be855adc4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:09.083016 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0ac75c2b-1006-49f8-9c41-936be855adc4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:09.169456 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4e0e82ec-436b-411f-a636-ec61393951ff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28599 microversion: 2.20 time: 0.174369 Jul 30 16:09:09.170261 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 178/352] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:08 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:09:09.176089 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d2583a70-830e-470f-9578-84969f666cd5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:09.177156 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d2583a70-830e-470f-9578-84969f666cd5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:09.184321 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d2583a70-830e-470f-9578-84969f666cd5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:09.184892 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d2583a70-830e-470f-9578-84969f666cd5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:09.185773 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d2583a70-830e-470f-9578-84969f666cd5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:09.186345 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d2583a70-830e-470f-9578-84969f666cd5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:09.213107 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0ac75c2b-1006-49f8-9c41-936be855adc4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:09.222120 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0ac75c2b-1006-49f8-9c41-936be855adc4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8" status: 200 len: 1318 microversion: 2.1 time: 0.151042 Jul 30 16:09:09.222686 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 175/353] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:09 2021] GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:09.327487 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d2583a70-830e-470f-9578-84969f666cd5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28655 microversion: 2.1 time: 0.154756 Jul 30 16:09:09.329356 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 179/354] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:09 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:09.654538 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-47504c64-fa68-49a6-8b0a-e9e1334c007d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-782755277", "imageRef": "eea29a7d-10c3-489a-adee-10be2e7a26bd", "flavorRef": "452", "networks": [{"uuid": "1532ae73-edd4-48ea-b12b-b0dca0c66e2a"}]}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:09.710885 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.network.neutron [None req-47504c64-fa68-49a6-8b0a-e9e1334c007d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] validate_networks() for [('1532ae73-edd4-48ea-b12b-b0dca0c66e2a', None, None, None)] {{(pid=107452) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:09:10.039956 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9e969682-45e1-4fff-92a1-8e22af921810 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:10.040657 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9e969682-45e1-4fff-92a1-8e22af921810 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:10.047864 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9e969682-45e1-4fff-92a1-8e22af921810 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:10.048306 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9e969682-45e1-4fff-92a1-8e22af921810 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:10.049021 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9e969682-45e1-4fff-92a1-8e22af921810 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:10.049462 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9e969682-45e1-4fff-92a1-8e22af921810 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:10.174782 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9e969682-45e1-4fff-92a1-8e22af921810 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:10.182318 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9e969682-45e1-4fff-92a1-8e22af921810 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.146297 Jul 30 16:09:10.182870 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 180/355] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:10 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:09:10.187603 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-eeed4b3d-19b2-4135-bd2c-c9cca8e2541e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:10.188505 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-eeed4b3d-19b2-4135-bd2c-c9cca8e2541e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:10.194140 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-eeed4b3d-19b2-4135-bd2c-c9cca8e2541e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:10.194587 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-eeed4b3d-19b2-4135-bd2c-c9cca8e2541e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:10.195507 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-eeed4b3d-19b2-4135-bd2c-c9cca8e2541e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:10.195944 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-eeed4b3d-19b2-4135-bd2c-c9cca8e2541e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:10.219164 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-47504c64-fa68-49a6-8b0a-e9e1334c007d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Flavor limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:09:10.219658 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-47504c64-fa68-49a6-8b0a-e9e1334c007d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Image limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:09:10.220149 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-47504c64-fa68-49a6-8b0a-e9e1334c007d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Flavor pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:09:10.220774 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-47504c64-fa68-49a6-8b0a-e9e1334c007d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Image pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:09:10.221251 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-47504c64-fa68-49a6-8b0a-e9e1334c007d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:09:10.230290 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-47504c64-fa68-49a6-8b0a-e9e1334c007d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:10.230799 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-47504c64-fa68-49a6-8b0a-e9e1334c007d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:10.231647 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-47504c64-fa68-49a6-8b0a-e9e1334c007d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:10.232184 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-47504c64-fa68-49a6-8b0a-e9e1334c007d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:10.250485 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-47504c64-fa68-49a6-8b0a-e9e1334c007d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Getting quotas for project e2bbd6beaee8450d825abd418910d05c. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:09:10.254371 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-47504c64-fa68-49a6-8b0a-e9e1334c007d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Getting quotas for user 5ce25fb105324bd3a8216f224b2251d8 and project e2bbd6beaee8450d825abd418910d05c. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:09:10.265401 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-47504c64-fa68-49a6-8b0a-e9e1334c007d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Going to run 1 instances... {{(pid=107452) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:09:10.267716 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-47504c64-fa68-49a6-8b0a-e9e1334c007d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eea29a7d-10c3-489a-adee-10be2e7a26bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:09:10.314679 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-47504c64-fa68-49a6-8b0a-e9e1334c007d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663693 Jul 30 16:09:10.315435 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 176/356] 10.222.0.37 () {60 vars in 1147 bytes} [Fri Jul 30 16:09:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 16:09:10.319762 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-cbadc09a-9ba9-460a-8b62-5710ca2a9536 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:10.320362 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-cbadc09a-9ba9-460a-8b62-5710ca2a9536 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:10.326274 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cbadc09a-9ba9-460a-8b62-5710ca2a9536 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:10.327394 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cbadc09a-9ba9-460a-8b62-5710ca2a9536 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:10.328179 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cbadc09a-9ba9-460a-8b62-5710ca2a9536 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:10.328611 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cbadc09a-9ba9-460a-8b62-5710ca2a9536 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:10.332472 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-eeed4b3d-19b2-4135-bd2c-c9cca8e2541e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28599 microversion: 2.20 time: 0.148034 Jul 30 16:09:10.333259 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 181/357] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:10 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:10.343238 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4dd44721-712b-4431-9a3b-b7dedc123b32 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:10.344639 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4dd44721-712b-4431-9a3b-b7dedc123b32 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:10.400787 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4dd44721-712b-4431-9a3b-b7dedc123b32 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:10.408032 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4dd44721-712b-4431-9a3b-b7dedc123b32 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 200 len: 1218 microversion: 2.1 time: 0.072555 Jul 30 16:09:10.408851 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 182/358] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:10 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:10.426946 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-52ece4a3-d9cb-4139-8685-8b2443eba4df tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:10.431792 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-52ece4a3-d9cb-4139-8685-8b2443eba4df tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:10.440105 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-52ece4a3-d9cb-4139-8685-8b2443eba4df tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:10.440810 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-52ece4a3-d9cb-4139-8685-8b2443eba4df tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:10.441617 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-52ece4a3-d9cb-4139-8685-8b2443eba4df tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:10.442033 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-52ece4a3-d9cb-4139-8685-8b2443eba4df tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:10.550286 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-cbadc09a-9ba9-460a-8b62-5710ca2a9536 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:10.562461 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-cbadc09a-9ba9-460a-8b62-5710ca2a9536 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8" status: 200 len: 1318 microversion: 2.1 time: 0.245912 Jul 30 16:09:10.571834 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 177/359] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:10 2021] GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:10.648211 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-52ece4a3-d9cb-4139-8685-8b2443eba4df tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28655 microversion: 2.1 time: 0.237716 Jul 30 16:09:10.649175 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 183/360] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:10 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28655 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:11.198977 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-203f9762-6f63-492e-99d1-622b88a862d2 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:11.199522 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-203f9762-6f63-492e-99d1-622b88a862d2 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:11.206420 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-203f9762-6f63-492e-99d1-622b88a862d2 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:11.206871 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-203f9762-6f63-492e-99d1-622b88a862d2 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:11.207668 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-203f9762-6f63-492e-99d1-622b88a862d2 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:11.208104 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-203f9762-6f63-492e-99d1-622b88a862d2 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:11.330903 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-203f9762-6f63-492e-99d1-622b88a862d2 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:11.338154 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-203f9762-6f63-492e-99d1-622b88a862d2 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.142934 Jul 30 16:09:11.338718 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 178/361] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:11 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:11.346147 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9522ae62-507e-4d1a-bade-6f8120ce2936 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:11.347253 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9522ae62-507e-4d1a-bade-6f8120ce2936 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:11.353781 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9522ae62-507e-4d1a-bade-6f8120ce2936 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:11.354329 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9522ae62-507e-4d1a-bade-6f8120ce2936 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:11.355314 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9522ae62-507e-4d1a-bade-6f8120ce2936 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:11.355802 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9522ae62-507e-4d1a-bade-6f8120ce2936 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:11.425184 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-34a7d3ba-2d03-495c-a1f8-f4106a8adc71 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:11.425908 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-34a7d3ba-2d03-495c-a1f8-f4106a8adc71 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:11.431933 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-34a7d3ba-2d03-495c-a1f8-f4106a8adc71 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:11.432385 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-34a7d3ba-2d03-495c-a1f8-f4106a8adc71 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:11.433172 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-34a7d3ba-2d03-495c-a1f8-f4106a8adc71 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:11.433595 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-34a7d3ba-2d03-495c-a1f8-f4106a8adc71 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:11.462221 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9522ae62-507e-4d1a-bade-6f8120ce2936 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28599 microversion: 2.20 time: 0.120394 Jul 30 16:09:11.464095 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 184/362] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:11 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28599 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:11.499309 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-34a7d3ba-2d03-495c-a1f8-f4106a8adc71 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:11.506814 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-34a7d3ba-2d03-495c-a1f8-f4106a8adc71 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 200 len: 1270 microversion: 2.1 time: 0.085303 Jul 30 16:09:11.507403 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 179/363] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:11 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:09:11.579661 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-55764fcc-03a0-4d2f-9e47-1e456f3a9930 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:11.580359 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-55764fcc-03a0-4d2f-9e47-1e456f3a9930 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:11.586740 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-55764fcc-03a0-4d2f-9e47-1e456f3a9930 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:11.587280 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-55764fcc-03a0-4d2f-9e47-1e456f3a9930 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:11.588050 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-55764fcc-03a0-4d2f-9e47-1e456f3a9930 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:11.588487 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-55764fcc-03a0-4d2f-9e47-1e456f3a9930 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:11.664472 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-719211fa-1955-4ec2-953a-187cc971c40d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:11.665599 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-719211fa-1955-4ec2-953a-187cc971c40d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:11.678075 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-719211fa-1955-4ec2-953a-187cc971c40d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:11.678675 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-719211fa-1955-4ec2-953a-187cc971c40d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:11.679866 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-719211fa-1955-4ec2-953a-187cc971c40d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:11.680831 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-719211fa-1955-4ec2-953a-187cc971c40d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:11.713410 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-55764fcc-03a0-4d2f-9e47-1e456f3a9930 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:11.720917 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-55764fcc-03a0-4d2f-9e47-1e456f3a9930 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8" status: 200 len: 1508 microversion: 2.1 time: 0.145736 Jul 30 16:09:11.721535 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 185/364] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:11 2021] GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:11.736673 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1204cfda-dca1-4aab-93df-2f36f6f6c7e5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17ee5861-c1d7-4982-ab8f-0e2a428ed069"}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:11.737726 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1204cfda-dca1-4aab-93df-2f36f6f6c7e5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:11.743452 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1204cfda-dca1-4aab-93df-2f36f6f6c7e5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:11.743908 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1204cfda-dca1-4aab-93df-2f36f6f6c7e5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:11.744681 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1204cfda-dca1-4aab-93df-2f36f6f6c7e5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:11.745194 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1204cfda-dca1-4aab-93df-2f36f6f6c7e5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:11.838346 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-719211fa-1955-4ec2-953a-187cc971c40d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28655 microversion: 2.1 time: 0.180572 Jul 30 16:09:11.843501 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 180/365] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:11 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28655 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:11.857052 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-1204cfda-dca1-4aab-93df-2f36f6f6c7e5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] HTTP exception thrown: Invalid volume: volume 17ee5861-c1d7-4982-ab8f-0e2a428ed069 is already attached to instances: babe3fe6-376a-4331-8d5d-c2dd904a9fa2 Jul 30 16:09:11.857565 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1204cfda-dca1-4aab-93df-2f36f6f6c7e5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Returning 400 to user: Invalid volume: volume 17ee5861-c1d7-4982-ab8f-0e2a428ed069 is already attached to instances: babe3fe6-376a-4331-8d5d-c2dd904a9fa2 {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:09:11.858627 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1204cfda-dca1-4aab-93df-2f36f6f6c7e5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "POST /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.125688 Jul 30 16:09:11.862965 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 186/366] 10.222.0.37 () {60 vars in 1323 bytes} [Fri Jul 30 16:09:11 2021] POST /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8/os-volume_attachments => generated 174 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 30 16:09:11.934667 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ad84fd5e-f4dc-4d89-8190-1fdd61225dad tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:11.935363 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ad84fd5e-f4dc-4d89-8190-1fdd61225dad tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:11.943509 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ad84fd5e-f4dc-4d89-8190-1fdd61225dad tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:11.943956 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ad84fd5e-f4dc-4d89-8190-1fdd61225dad tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:11.944728 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ad84fd5e-f4dc-4d89-8190-1fdd61225dad tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:11.945156 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ad84fd5e-f4dc-4d89-8190-1fdd61225dad tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:12.080774 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.objects.instance [None req-ad84fd5e-f4dc-4d89-8190-1fdd61225dad tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lazy-loading 'services' on Instance uuid babe3fe6-376a-4331-8d5d-c2dd904a9fa2 {{(pid=107452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:09:12.339444 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ad84fd5e-f4dc-4d89-8190-1fdd61225dad tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "DELETE /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2/os-volume_attachments/17ee5861-c1d7-4982-ab8f-0e2a428ed069" status: 202 len: 0 microversion: 2.1 time: 0.408632 Jul 30 16:09:12.340135 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 181/367] 10.222.0.37 () {58 vars in 1416 bytes} [Fri Jul 30 16:09:11 2021] DELETE /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2/os-volume_attachments/17ee5861-c1d7-4982-ab8f-0e2a428ed069 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:12.355455 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f859a725-60fd-43a0-88bc-86c2cad57512 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:12.356075 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f859a725-60fd-43a0-88bc-86c2cad57512 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:12.370719 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f859a725-60fd-43a0-88bc-86c2cad57512 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:12.371339 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f859a725-60fd-43a0-88bc-86c2cad57512 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:12.372207 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f859a725-60fd-43a0-88bc-86c2cad57512 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:12.372885 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f859a725-60fd-43a0-88bc-86c2cad57512 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:12.486795 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-79349f8c-3b98-4654-93b2-1df5f29c1e07 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:12.488137 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-79349f8c-3b98-4654-93b2-1df5f29c1e07 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:12.498673 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-79349f8c-3b98-4654-93b2-1df5f29c1e07 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:12.499419 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-79349f8c-3b98-4654-93b2-1df5f29c1e07 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:12.500599 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-79349f8c-3b98-4654-93b2-1df5f29c1e07 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:12.501409 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-79349f8c-3b98-4654-93b2-1df5f29c1e07 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:12.526510 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f859a725-60fd-43a0-88bc-86c2cad57512 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:12.535178 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f859a725-60fd-43a0-88bc-86c2cad57512 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.183752 Jul 30 16:09:12.535740 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 187/368] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:12 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:12.540219 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-09df28f5-5429-46d5-bbdf-5f66cc6c9533 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:12.540820 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-09df28f5-5429-46d5-bbdf-5f66cc6c9533 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:12.546541 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-09df28f5-5429-46d5-bbdf-5f66cc6c9533 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:12.546987 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-09df28f5-5429-46d5-bbdf-5f66cc6c9533 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:12.547954 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-09df28f5-5429-46d5-bbdf-5f66cc6c9533 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:12.548381 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-09df28f5-5429-46d5-bbdf-5f66cc6c9533 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:12.645288 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-79349f8c-3b98-4654-93b2-1df5f29c1e07 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28599 microversion: 2.20 time: 0.168643 Jul 30 16:09:12.646538 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 182/369] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:12 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:09:12.666803 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-09df28f5-5429-46d5-bbdf-5f66cc6c9533 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:12.674187 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-09df28f5-5429-46d5-bbdf-5f66cc6c9533 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 200 len: 1318 microversion: 2.1 time: 0.137318 Jul 30 16:09:12.674950 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 188/370] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:12 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:12.850359 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-2b9a3533-4f01-4ee6-88c4-2222ffc15d63 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:12.851498 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-2b9a3533-4f01-4ee6-88c4-2222ffc15d63 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:12.858233 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2b9a3533-4f01-4ee6-88c4-2222ffc15d63 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:12.859238 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2b9a3533-4f01-4ee6-88c4-2222ffc15d63 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:12.859732 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2b9a3533-4f01-4ee6-88c4-2222ffc15d63 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:12.860270 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2b9a3533-4f01-4ee6-88c4-2222ffc15d63 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:12.963629 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-2b9a3533-4f01-4ee6-88c4-2222ffc15d63 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28655 microversion: 2.1 time: 0.117405 Jul 30 16:09:12.968722 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 183/371] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:12 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28655 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:13.149329 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-a112439d-3c85-4253-92e3-b451ef138aa9 req-f79b8a6f-0ef9-47be-87f4-c40d451c4fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96da483e-dc7d-4c23-b608-22490f6b4b4a", "tag": "49f42183-504d-4e4f-9f31-34ca7e547fa0"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:13.151341 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:09:13.151341 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:09:13.159617 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-a112439d-3c85-4253-92e3-b451ef138aa9 req-f79b8a6f-0ef9-47be-87f4-c40d451c4fed service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:13.160526 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-a112439d-3c85-4253-92e3-b451ef138aa9 req-f79b8a6f-0ef9-47be-87f4-c40d451c4fed service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:13.173503 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-a112439d-3c85-4253-92e3-b451ef138aa9 req-f79b8a6f-0ef9-47be-87f4-c40d451c4fed service nova] Creating event network-changed:49f42183-504d-4e4f-9f31-34ca7e547fa0 for instance 96da483e-dc7d-4c23-b608-22490f6b4b4a on hv-cinder-80304 Jul 30 16:09:13.178492 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-a112439d-3c85-4253-92e3-b451ef138aa9 req-f79b8a6f-0ef9-47be-87f4-c40d451c4fed service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032743 Jul 30 16:09:13.187450 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 189/372] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:09:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:09:13.552579 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6d0e45da-2937-43f9-9c31-328d0de96642 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:13.553202 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6d0e45da-2937-43f9-9c31-328d0de96642 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:13.559613 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6d0e45da-2937-43f9-9c31-328d0de96642 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:13.560093 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6d0e45da-2937-43f9-9c31-328d0de96642 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:13.561048 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6d0e45da-2937-43f9-9c31-328d0de96642 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:13.561484 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6d0e45da-2937-43f9-9c31-328d0de96642 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:13.657926 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e3dc3851-a7ae-4f3a-98c9-cf09fcb7466c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:13.659739 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e3dc3851-a7ae-4f3a-98c9-cf09fcb7466c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:13.667442 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e3dc3851-a7ae-4f3a-98c9-cf09fcb7466c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:13.668865 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e3dc3851-a7ae-4f3a-98c9-cf09fcb7466c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:13.669760 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e3dc3851-a7ae-4f3a-98c9-cf09fcb7466c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:13.670210 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e3dc3851-a7ae-4f3a-98c9-cf09fcb7466c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:13.756954 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6d0e45da-2937-43f9-9c31-328d0de96642 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:13.765213 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6d0e45da-2937-43f9-9c31-328d0de96642 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.216761 Jul 30 16:09:13.765809 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 184/373] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:13 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:13.770156 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e3da5627-e3aa-4d60-80d1-81e16da89878 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:13.770848 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e3da5627-e3aa-4d60-80d1-81e16da89878 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:13.778858 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e3da5627-e3aa-4d60-80d1-81e16da89878 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:13.779344 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e3da5627-e3aa-4d60-80d1-81e16da89878 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:13.780800 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e3da5627-e3aa-4d60-80d1-81e16da89878 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:13.781237 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e3da5627-e3aa-4d60-80d1-81e16da89878 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:13.804927 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e3dc3851-a7ae-4f3a-98c9-cf09fcb7466c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28599 microversion: 2.20 time: 0.151735 Jul 30 16:09:13.808837 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 190/374] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:13 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:09:13.975981 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e3da5627-e3aa-4d60-80d1-81e16da89878 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:13.977880 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9e57edc5-d73f-4024-8e8c-f9f280a6ede8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:13.978875 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9e57edc5-d73f-4024-8e8c-f9f280a6ede8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:13.985220 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e3da5627-e3aa-4d60-80d1-81e16da89878 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 200 len: 1318 microversion: 2.1 time: 0.218376 Jul 30 16:09:13.985709 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9e57edc5-d73f-4024-8e8c-f9f280a6ede8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:13.986165 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9e57edc5-d73f-4024-8e8c-f9f280a6ede8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:13.986703 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 185/375] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:13 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:13.986921 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9e57edc5-d73f-4024-8e8c-f9f280a6ede8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:13.987387 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9e57edc5-d73f-4024-8e8c-f9f280a6ede8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:14.150801 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9e57edc5-d73f-4024-8e8c-f9f280a6ede8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28655 microversion: 2.1 time: 0.178410 Jul 30 16:09:14.151471 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 191/376] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:13 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28655 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:14.614118 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-7bc3c095-9aed-49ae-a9ad-bd134f896f69 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-269568971", "imageRef": "eea29a7d-10c3-489a-adee-10be2e7a26bd", "flavorRef": "452", "networks": [{"uuid": "9a836950-de83-4064-be6b-b98de3093a5e"}]}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:14.668812 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.network.neutron [None req-7bc3c095-9aed-49ae-a9ad-bd134f896f69 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] validate_networks() for [('9a836950-de83-4064-be6b-b98de3093a5e', None, None, None)] {{(pid=107452) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:09:14.782517 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-93f9bca1-7f21-4f4f-a523-0802012058b3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:14.783233 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-93f9bca1-7f21-4f4f-a523-0802012058b3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:14.790652 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93f9bca1-7f21-4f4f-a523-0802012058b3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:14.791380 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93f9bca1-7f21-4f4f-a523-0802012058b3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:14.792244 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93f9bca1-7f21-4f4f-a523-0802012058b3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:14.792909 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93f9bca1-7f21-4f4f-a523-0802012058b3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:14.922568 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-93f9bca1-7f21-4f4f-a523-0802012058b3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:14.930367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-93f9bca1-7f21-4f4f-a523-0802012058b3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.152234 Jul 30 16:09:14.931063 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 192/377] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:14 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:09:14.935804 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0568bc78-fa36-40ec-81ea-9fc6e9bf4ce6 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:14.936855 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0568bc78-fa36-40ec-81ea-9fc6e9bf4ce6 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:14.943065 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0568bc78-fa36-40ec-81ea-9fc6e9bf4ce6 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:14.943545 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0568bc78-fa36-40ec-81ea-9fc6e9bf4ce6 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:14.944323 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0568bc78-fa36-40ec-81ea-9fc6e9bf4ce6 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:14.944761 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0568bc78-fa36-40ec-81ea-9fc6e9bf4ce6 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:15.047811 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0568bc78-fa36-40ec-81ea-9fc6e9bf4ce6 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28599 microversion: 2.20 time: 0.115298 Jul 30 16:09:15.048451 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 193/378] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:14 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28599 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:15.053304 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-288a0aee-3aeb-4778-82db-68464a572f8e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:15.053997 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-288a0aee-3aeb-4778-82db-68464a572f8e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:15.060702 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-288a0aee-3aeb-4778-82db-68464a572f8e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:15.061842 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-288a0aee-3aeb-4778-82db-68464a572f8e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:15.062727 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-288a0aee-3aeb-4778-82db-68464a572f8e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:15.063182 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-288a0aee-3aeb-4778-82db-68464a572f8e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:15.239715 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-7bc3c095-9aed-49ae-a9ad-bd134f896f69 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Flavor limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:09:15.240214 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-7bc3c095-9aed-49ae-a9ad-bd134f896f69 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Image limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:09:15.240757 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-7bc3c095-9aed-49ae-a9ad-bd134f896f69 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Flavor pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:09:15.241331 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-7bc3c095-9aed-49ae-a9ad-bd134f896f69 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Image pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:09:15.241750 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-7bc3c095-9aed-49ae-a9ad-bd134f896f69 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:09:15.251012 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7bc3c095-9aed-49ae-a9ad-bd134f896f69 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:15.251492 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7bc3c095-9aed-49ae-a9ad-bd134f896f69 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:15.252293 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7bc3c095-9aed-49ae-a9ad-bd134f896f69 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:15.252726 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7bc3c095-9aed-49ae-a9ad-bd134f896f69 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:15.269294 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-7bc3c095-9aed-49ae-a9ad-bd134f896f69 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Getting quotas for project e9b01b7e6d90426088cefd5ff16e7347. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:09:15.273289 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-7bc3c095-9aed-49ae-a9ad-bd134f896f69 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Getting quotas for user 0f16217b495748478088d59006761959 and project e9b01b7e6d90426088cefd5ff16e7347. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:09:15.283877 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7bc3c095-9aed-49ae-a9ad-bd134f896f69 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Going to run 1 instances... {{(pid=107452) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:09:15.286183 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7bc3c095-9aed-49ae-a9ad-bd134f896f69 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eea29a7d-10c3-489a-adee-10be2e7a26bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:09:15.329150 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-288a0aee-3aeb-4778-82db-68464a572f8e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:15.331633 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-7bc3c095-9aed-49ae-a9ad-bd134f896f69 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721131 Jul 30 16:09:15.332268 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 186/379] 10.222.0.37 () {60 vars in 1147 bytes} [Fri Jul 30 16:09:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 16:09:15.336927 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-288a0aee-3aeb-4778-82db-68464a572f8e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 200 len: 1318 microversion: 2.1 time: 0.287349 Jul 30 16:09:15.346663 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 194/380] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:15 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:15.346845 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c3bdd71a-5b12-410c-97c5-7028f9dc74a0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:15.346976 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a51c8b52-cfd6-4517-a81d-bc60f9dce718 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:15.347077 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c3bdd71a-5b12-410c-97c5-7028f9dc74a0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:15.347199 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a51c8b52-cfd6-4517-a81d-bc60f9dce718 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:15.349775 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c3bdd71a-5b12-410c-97c5-7028f9dc74a0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:15.350237 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c3bdd71a-5b12-410c-97c5-7028f9dc74a0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:15.351049 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c3bdd71a-5b12-410c-97c5-7028f9dc74a0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:15.351514 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c3bdd71a-5b12-410c-97c5-7028f9dc74a0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:15.412289 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a51c8b52-cfd6-4517-a81d-bc60f9dce718 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:15.418711 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a51c8b52-cfd6-4517-a81d-bc60f9dce718 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1217 microversion: 2.1 time: 0.079943 Jul 30 16:09:15.419196 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 195/381] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:15 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:15.467044 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c3bdd71a-5b12-410c-97c5-7028f9dc74a0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28655 microversion: 2.1 time: 0.133230 Jul 30 16:09:15.468078 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 187/382] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:15 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28655 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:15.946768 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4ee5122d-a788-4175-b670-f88146a476bb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:15.947877 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4ee5122d-a788-4175-b670-f88146a476bb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:15.954207 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4ee5122d-a788-4175-b670-f88146a476bb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:15.954579 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4ee5122d-a788-4175-b670-f88146a476bb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:15.955479 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4ee5122d-a788-4175-b670-f88146a476bb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:15.955913 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4ee5122d-a788-4175-b670-f88146a476bb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:16.065428 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1a7ef400-5162-42f9-9a66-bf194c49f8a9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:16.066429 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1a7ef400-5162-42f9-9a66-bf194c49f8a9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:16.074626 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1a7ef400-5162-42f9-9a66-bf194c49f8a9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:16.075350 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1a7ef400-5162-42f9-9a66-bf194c49f8a9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:16.076424 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1a7ef400-5162-42f9-9a66-bf194c49f8a9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:16.077429 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1a7ef400-5162-42f9-9a66-bf194c49f8a9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:16.078158 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4ee5122d-a788-4175-b670-f88146a476bb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:16.085697 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4ee5122d-a788-4175-b670-f88146a476bb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.142506 Jul 30 16:09:16.086269 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 196/383] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:15 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:16.185150 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1a7ef400-5162-42f9-9a66-bf194c49f8a9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28599 microversion: 2.20 time: 0.128966 Jul 30 16:09:16.185698 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 188/384] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:16 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28599 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:09:16.353856 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-42604d23-a328-45c9-b202-08c11d0458bb tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:16.354463 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-42604d23-a328-45c9-b202-08c11d0458bb tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:16.361029 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-42604d23-a328-45c9-b202-08c11d0458bb tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:16.361474 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-42604d23-a328-45c9-b202-08c11d0458bb tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:16.362233 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-42604d23-a328-45c9-b202-08c11d0458bb tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:16.362661 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-42604d23-a328-45c9-b202-08c11d0458bb tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:16.436349 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-65592e83-cb54-4746-a2da-6571b28e9ff9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:16.437042 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-65592e83-cb54-4746-a2da-6571b28e9ff9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:16.443578 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-65592e83-cb54-4746-a2da-6571b28e9ff9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:16.444032 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-65592e83-cb54-4746-a2da-6571b28e9ff9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:16.445566 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-65592e83-cb54-4746-a2da-6571b28e9ff9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:16.446190 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-65592e83-cb54-4746-a2da-6571b28e9ff9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:16.494961 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-42604d23-a328-45c9-b202-08c11d0458bb tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:16.502925 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-42604d23-a328-45c9-b202-08c11d0458bb tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 200 len: 1318 microversion: 2.1 time: 0.152746 Jul 30 16:09:16.503808 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 197/385] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:16 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:16.508213 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-6e20e923-1f2e-4445-98f9-5448a09156f5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:16.509189 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-6e20e923-1f2e-4445-98f9-5448a09156f5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:16.516683 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6e20e923-1f2e-4445-98f9-5448a09156f5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:16.517132 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6e20e923-1f2e-4445-98f9-5448a09156f5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:16.517916 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6e20e923-1f2e-4445-98f9-5448a09156f5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:16.518349 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6e20e923-1f2e-4445-98f9-5448a09156f5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:16.526441 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-65592e83-cb54-4746-a2da-6571b28e9ff9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:16.535076 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-65592e83-cb54-4746-a2da-6571b28e9ff9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1269 microversion: 2.1 time: 0.102908 Jul 30 16:09:16.536034 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 189/386] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:16 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1269 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:09:16.636643 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-6e20e923-1f2e-4445-98f9-5448a09156f5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28655 microversion: 2.1 time: 0.131230 Jul 30 16:09:16.641372 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 198/387] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:16 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28655 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:17.103288 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-fa6c8dbd-0ad5-46e5-8e93-ed3081593909 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:17.104149 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-fa6c8dbd-0ad5-46e5-8e93-ed3081593909 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:17.110770 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fa6c8dbd-0ad5-46e5-8e93-ed3081593909 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:17.111476 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fa6c8dbd-0ad5-46e5-8e93-ed3081593909 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:17.112633 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fa6c8dbd-0ad5-46e5-8e93-ed3081593909 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:17.113117 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fa6c8dbd-0ad5-46e5-8e93-ed3081593909 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:17.197583 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-40e09454-b450-4f48-b6ad-7f8493ce01f7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:17.198946 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-40e09454-b450-4f48-b6ad-7f8493ce01f7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:17.206168 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-40e09454-b450-4f48-b6ad-7f8493ce01f7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:17.206841 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-40e09454-b450-4f48-b6ad-7f8493ce01f7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:17.207663 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-40e09454-b450-4f48-b6ad-7f8493ce01f7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:17.208107 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-40e09454-b450-4f48-b6ad-7f8493ce01f7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:17.333843 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-fa6c8dbd-0ad5-46e5-8e93-ed3081593909 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:17.337392 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-40e09454-b450-4f48-b6ad-7f8493ce01f7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28599 microversion: 2.20 time: 0.143559 Jul 30 16:09:17.338340 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 199/388] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:17 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:17.341571 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-fa6c8dbd-0ad5-46e5-8e93-ed3081593909 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.242309 Jul 30 16:09:17.342411 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 190/389] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:17 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:17.521092 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d186140b-fc42-4b88-809c-eb86c460851b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:17.521708 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d186140b-fc42-4b88-809c-eb86c460851b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:17.528136 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d186140b-fc42-4b88-809c-eb86c460851b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:17.528585 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d186140b-fc42-4b88-809c-eb86c460851b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:17.529355 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d186140b-fc42-4b88-809c-eb86c460851b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:17.530400 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d186140b-fc42-4b88-809c-eb86c460851b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:17.552099 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-61d30f13-6119-4a4e-85e0-c570239c6563 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:17.552904 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-61d30f13-6119-4a4e-85e0-c570239c6563 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:17.559681 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61d30f13-6119-4a4e-85e0-c570239c6563 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:17.560209 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61d30f13-6119-4a4e-85e0-c570239c6563 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:17.561210 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61d30f13-6119-4a4e-85e0-c570239c6563 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:17.561815 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61d30f13-6119-4a4e-85e0-c570239c6563 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:17.654137 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d186140b-fc42-4b88-809c-eb86c460851b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:17.661970 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d186140b-fc42-4b88-809c-eb86c460851b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 200 len: 1318 microversion: 2.1 time: 0.144982 Jul 30 16:09:17.662600 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 200/390] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:17 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:17.666981 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-575504e5-c07c-4422-87da-82d0c88f00d7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:17.668090 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-575504e5-c07c-4422-87da-82d0c88f00d7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:17.673804 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-575504e5-c07c-4422-87da-82d0c88f00d7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:17.674251 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-575504e5-c07c-4422-87da-82d0c88f00d7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:17.675032 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-575504e5-c07c-4422-87da-82d0c88f00d7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:17.675527 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-575504e5-c07c-4422-87da-82d0c88f00d7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:17.778501 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-61d30f13-6119-4a4e-85e0-c570239c6563 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:17.785259 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-575504e5-c07c-4422-87da-82d0c88f00d7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28655 microversion: 2.1 time: 0.120819 Jul 30 16:09:17.794531 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 201/391] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:17 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28655 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:17.803399 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-61d30f13-6119-4a4e-85e0-c570239c6563 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1317 microversion: 2.1 time: 0.254891 Jul 30 16:09:17.804460 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 191/392] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:17 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:17.960037 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-76919c5d-4096-4255-9cbc-fb150f0e8d26 req-30334062-2dbf-4986-91e4-7c0c0b6a678b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449fc7f2-a7de-4c24-928e-9bd3294b773f", "tag": "52e600d7-de11-4a97-8436-e389bd5707d1"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:17.966863 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:09:17.966863 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:09:17.977669 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-76919c5d-4096-4255-9cbc-fb150f0e8d26 req-30334062-2dbf-4986-91e4-7c0c0b6a678b service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:17.978139 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-76919c5d-4096-4255-9cbc-fb150f0e8d26 req-30334062-2dbf-4986-91e4-7c0c0b6a678b service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:17.995846 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-76919c5d-4096-4255-9cbc-fb150f0e8d26 req-30334062-2dbf-4986-91e4-7c0c0b6a678b service nova] Creating event network-changed:52e600d7-de11-4a97-8436-e389bd5707d1 for instance 449fc7f2-a7de-4c24-928e-9bd3294b773f on hv-cinder-80304 Jul 30 16:09:18.000949 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-76919c5d-4096-4255-9cbc-fb150f0e8d26 req-30334062-2dbf-4986-91e4-7c0c0b6a678b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044859 Jul 30 16:09:18.001521 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 202/393] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:09:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:09:18.348626 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ae2869c4-31c0-4c02-bbde-a5fcd49d3233 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:18.349732 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ae2869c4-31c0-4c02-bbde-a5fcd49d3233 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:18.358343 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-460fe064-6910-4167-bee7-d1f37f500ec6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:18.359044 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-460fe064-6910-4167-bee7-d1f37f500ec6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:18.362405 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ae2869c4-31c0-4c02-bbde-a5fcd49d3233 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:18.362860 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ae2869c4-31c0-4c02-bbde-a5fcd49d3233 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:18.363746 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ae2869c4-31c0-4c02-bbde-a5fcd49d3233 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:18.364157 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ae2869c4-31c0-4c02-bbde-a5fcd49d3233 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:18.364972 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-460fe064-6910-4167-bee7-d1f37f500ec6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:18.365417 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-460fe064-6910-4167-bee7-d1f37f500ec6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:18.366562 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-460fe064-6910-4167-bee7-d1f37f500ec6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:18.367115 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-460fe064-6910-4167-bee7-d1f37f500ec6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:18.489860 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ae2869c4-31c0-4c02-bbde-a5fcd49d3233 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28599 microversion: 2.20 time: 0.144759 Jul 30 16:09:18.491440 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 192/394] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:18 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:18.538444 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-460fe064-6910-4167-bee7-d1f37f500ec6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:18.549062 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-460fe064-6910-4167-bee7-d1f37f500ec6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.193879 Jul 30 16:09:18.550445 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 203/395] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:18 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:09:18.679376 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-87635f67-f08a-4e97-b6dd-f043324e5a89 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:18.680329 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-87635f67-f08a-4e97-b6dd-f043324e5a89 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:18.687434 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-87635f67-f08a-4e97-b6dd-f043324e5a89 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:18.687893 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-87635f67-f08a-4e97-b6dd-f043324e5a89 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:18.688707 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-87635f67-f08a-4e97-b6dd-f043324e5a89 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:18.689147 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-87635f67-f08a-4e97-b6dd-f043324e5a89 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:18.796188 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-cc4befc6-228a-4af6-b50b-e48aa14e9125 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:18.797091 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-cc4befc6-228a-4af6-b50b-e48aa14e9125 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:18.803158 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cc4befc6-228a-4af6-b50b-e48aa14e9125 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:18.803961 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cc4befc6-228a-4af6-b50b-e48aa14e9125 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:18.804395 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cc4befc6-228a-4af6-b50b-e48aa14e9125 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:18.804867 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cc4befc6-228a-4af6-b50b-e48aa14e9125 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:18.888827 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-87635f67-f08a-4e97-b6dd-f043324e5a89 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:18.897413 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-87635f67-f08a-4e97-b6dd-f043324e5a89 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 200 len: 1318 microversion: 2.1 time: 0.222265 Jul 30 16:09:18.898283 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 193/396] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:18 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:18.910504 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-4a665a15-8a84-4390-b6fc-9a88f27eb45a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:18.911282 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-4a665a15-8a84-4390-b6fc-9a88f27eb45a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:18.917778 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4a665a15-8a84-4390-b6fc-9a88f27eb45a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:18.918260 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4a665a15-8a84-4390-b6fc-9a88f27eb45a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:18.919062 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4a665a15-8a84-4390-b6fc-9a88f27eb45a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:18.919800 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4a665a15-8a84-4390-b6fc-9a88f27eb45a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:18.925845 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-cc4befc6-228a-4af6-b50b-e48aa14e9125 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28655 microversion: 2.1 time: 0.133298 Jul 30 16:09:18.926890 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 204/397] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:18 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28655 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:19.101759 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-4a665a15-8a84-4390-b6fc-9a88f27eb45a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:19.109533 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-4a665a15-8a84-4390-b6fc-9a88f27eb45a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1317 microversion: 2.1 time: 0.209964 Jul 30 16:09:19.110026 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 194/398] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:18 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:19.503347 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-37eb9fa1-badc-4fef-8821-d5be0498cb8e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:19.504522 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-37eb9fa1-badc-4fef-8821-d5be0498cb8e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:19.510925 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-37eb9fa1-badc-4fef-8821-d5be0498cb8e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:19.511407 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-37eb9fa1-badc-4fef-8821-d5be0498cb8e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:19.512178 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-37eb9fa1-badc-4fef-8821-d5be0498cb8e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:19.512609 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-37eb9fa1-badc-4fef-8821-d5be0498cb8e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:19.567442 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-68b06651-18dc-41dc-b657-e40c08a5247f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:19.568064 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-68b06651-18dc-41dc-b657-e40c08a5247f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:19.579983 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-68b06651-18dc-41dc-b657-e40c08a5247f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:19.580480 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-68b06651-18dc-41dc-b657-e40c08a5247f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:19.581257 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-68b06651-18dc-41dc-b657-e40c08a5247f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:19.581691 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-68b06651-18dc-41dc-b657-e40c08a5247f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:19.617851 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-37eb9fa1-badc-4fef-8821-d5be0498cb8e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28599 microversion: 2.20 time: 0.118385 Jul 30 16:09:19.618512 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 205/399] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:19 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28599 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:19.765159 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-68b06651-18dc-41dc-b657-e40c08a5247f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:19.772518 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-68b06651-18dc-41dc-b657-e40c08a5247f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.209020 Jul 30 16:09:19.773096 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 195/400] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:19 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:19.923023 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9b7d72c6-0d62-4b56-9d50-e81dfecf74e4 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:19.924951 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9b7d72c6-0d62-4b56-9d50-e81dfecf74e4 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:19.938106 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-00a051e6-4865-4e36-8a76-e83ae46db7cf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:19.939412 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-00a051e6-4865-4e36-8a76-e83ae46db7cf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:19.942398 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9b7d72c6-0d62-4b56-9d50-e81dfecf74e4 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:19.943214 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9b7d72c6-0d62-4b56-9d50-e81dfecf74e4 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:19.944289 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9b7d72c6-0d62-4b56-9d50-e81dfecf74e4 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:19.944810 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9b7d72c6-0d62-4b56-9d50-e81dfecf74e4 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:19.948515 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-00a051e6-4865-4e36-8a76-e83ae46db7cf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:19.948954 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-00a051e6-4865-4e36-8a76-e83ae46db7cf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:19.949748 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-00a051e6-4865-4e36-8a76-e83ae46db7cf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:19.950192 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-00a051e6-4865-4e36-8a76-e83ae46db7cf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:20.071521 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-00a051e6-4865-4e36-8a76-e83ae46db7cf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28655 microversion: 2.1 time: 0.137691 Jul 30 16:09:20.075638 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 196/401] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:19 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28655 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:09:20.086382 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9b7d72c6-0d62-4b56-9d50-e81dfecf74e4 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:20.094398 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9b7d72c6-0d62-4b56-9d50-e81dfecf74e4 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 200 len: 1318 microversion: 2.1 time: 0.183641 Jul 30 16:09:20.095177 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 206/402] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:19 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:20.127012 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-44073dd3-a746-4842-9e73-2139fefa0cc6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:20.128063 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-44073dd3-a746-4842-9e73-2139fefa0cc6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:20.134614 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-44073dd3-a746-4842-9e73-2139fefa0cc6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:20.135064 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-44073dd3-a746-4842-9e73-2139fefa0cc6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:20.136521 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-44073dd3-a746-4842-9e73-2139fefa0cc6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:20.136960 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-44073dd3-a746-4842-9e73-2139fefa0cc6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:20.316570 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-44073dd3-a746-4842-9e73-2139fefa0cc6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:20.323981 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-44073dd3-a746-4842-9e73-2139fefa0cc6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1317 microversion: 2.1 time: 0.201818 Jul 30 16:09:20.324540 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 197/403] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:20 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:20.630232 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2ee24a3e-17d7-4315-be2a-05531016bd01 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:20.631156 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-2ee24a3e-17d7-4315-be2a-05531016bd01 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:20.640699 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2ee24a3e-17d7-4315-be2a-05531016bd01 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:20.644907 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2ee24a3e-17d7-4315-be2a-05531016bd01 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:20.648042 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2ee24a3e-17d7-4315-be2a-05531016bd01 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:20.648701 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2ee24a3e-17d7-4315-be2a-05531016bd01 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:20.772142 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2ee24a3e-17d7-4315-be2a-05531016bd01 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28599 microversion: 2.20 time: 0.145424 Jul 30 16:09:20.774432 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 207/404] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:20 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:20.789579 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a5073795-cf85-4ccd-84cb-cca37f46c3b3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:20.790198 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a5073795-cf85-4ccd-84cb-cca37f46c3b3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:20.801386 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a5073795-cf85-4ccd-84cb-cca37f46c3b3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:20.801994 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a5073795-cf85-4ccd-84cb-cca37f46c3b3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:20.803002 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a5073795-cf85-4ccd-84cb-cca37f46c3b3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:20.803585 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a5073795-cf85-4ccd-84cb-cca37f46c3b3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:21.084437 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-fb371272-c6d1-4a85-b85e-ec031e5058dc tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:21.085442 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-fb371272-c6d1-4a85-b85e-ec031e5058dc tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:21.092644 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fb371272-c6d1-4a85-b85e-ec031e5058dc tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:21.093358 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fb371272-c6d1-4a85-b85e-ec031e5058dc tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:21.094150 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fb371272-c6d1-4a85-b85e-ec031e5058dc tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:21.094582 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fb371272-c6d1-4a85-b85e-ec031e5058dc tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:21.211540 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-fb371272-c6d1-4a85-b85e-ec031e5058dc tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28655 microversion: 2.1 time: 0.131100 Jul 30 16:09:21.213160 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 208/405] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:21 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28655 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:09:21.221256 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-bcadae79-a097-4271-b59c-7a495325b260 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:21.222286 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-bcadae79-a097-4271-b59c-7a495325b260 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:21.229154 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bcadae79-a097-4271-b59c-7a495325b260 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:21.229859 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bcadae79-a097-4271-b59c-7a495325b260 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:21.230690 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bcadae79-a097-4271-b59c-7a495325b260 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:21.231156 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bcadae79-a097-4271-b59c-7a495325b260 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:21.336091 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-a5073795-cf85-4ccd-84cb-cca37f46c3b3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:21.350673 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a5073795-cf85-4ccd-84cb-cca37f46c3b3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.564388 Jul 30 16:09:21.361906 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 198/406] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:20 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:21.378390 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-29915c38-ad5b-47e1-b0bc-d64d427f9c48 req-e356310d-6f5e-4a16-89c0-361564848a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96da483e-dc7d-4c23-b608-22490f6b4b4a", "name": "network-vif-plugged", "status": "completed", "tag": "49f42183-504d-4e4f-9f31-34ca7e547fa0"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:21.380644 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:09:21.380644 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:09:21.390909 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-bcadae79-a097-4271-b59c-7a495325b260 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:21.400814 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-29915c38-ad5b-47e1-b0bc-d64d427f9c48 req-e356310d-6f5e-4a16-89c0-361564848a09 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:21.401259 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-29915c38-ad5b-47e1-b0bc-d64d427f9c48 req-e356310d-6f5e-4a16-89c0-361564848a09 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:21.403047 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-bcadae79-a097-4271-b59c-7a495325b260 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 200 len: 1318 microversion: 2.1 time: 0.188284 Jul 30 16:09:21.405293 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 209/407] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:21 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:21.414227 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-29915c38-ad5b-47e1-b0bc-d64d427f9c48 req-e356310d-6f5e-4a16-89c0-361564848a09 service nova] Creating event network-vif-plugged:49f42183-504d-4e4f-9f31-34ca7e547fa0 for instance 96da483e-dc7d-4c23-b608-22490f6b4b4a on hv-cinder-80304 Jul 30 16:09:21.419735 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0a881e25-340a-4064-8b85-d1ddb58a275e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:21.420082 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-29915c38-ad5b-47e1-b0bc-d64d427f9c48 req-e356310d-6f5e-4a16-89c0-361564848a09 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046626 Jul 30 16:09:21.420515 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0a881e25-340a-4064-8b85-d1ddb58a275e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:21.421074 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 199/408] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:09:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:09:21.429978 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0a881e25-340a-4064-8b85-d1ddb58a275e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:21.430685 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0a881e25-340a-4064-8b85-d1ddb58a275e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:21.431685 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0a881e25-340a-4064-8b85-d1ddb58a275e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:21.432311 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0a881e25-340a-4064-8b85-d1ddb58a275e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:21.592184 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0a881e25-340a-4064-8b85-d1ddb58a275e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:21.599924 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0a881e25-340a-4064-8b85-d1ddb58a275e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1317 microversion: 2.1 time: 0.193267 Jul 30 16:09:21.600485 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 210/409] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:21 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:21.785824 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-bbada1c9-44d4-4722-8525-ec7a292deca2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:21.787064 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-bbada1c9-44d4-4722-8525-ec7a292deca2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:21.795359 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bbada1c9-44d4-4722-8525-ec7a292deca2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:21.796773 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bbada1c9-44d4-4722-8525-ec7a292deca2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:21.797316 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bbada1c9-44d4-4722-8525-ec7a292deca2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:21.797907 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bbada1c9-44d4-4722-8525-ec7a292deca2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:21.949865 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-bbada1c9-44d4-4722-8525-ec7a292deca2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28599 microversion: 2.20 time: 0.168290 Jul 30 16:09:21.950576 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 200/410] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:21 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:22.223305 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-06c9f0aa-1995-48c4-84d6-7049d8bebefd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:22.224906 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-06c9f0aa-1995-48c4-84d6-7049d8bebefd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:22.231423 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-06c9f0aa-1995-48c4-84d6-7049d8bebefd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:22.231872 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-06c9f0aa-1995-48c4-84d6-7049d8bebefd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:22.232643 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-06c9f0aa-1995-48c4-84d6-7049d8bebefd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:22.234037 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-06c9f0aa-1995-48c4-84d6-7049d8bebefd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:22.354927 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-06c9f0aa-1995-48c4-84d6-7049d8bebefd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 28771 microversion: 2.1 time: 0.134782 Jul 30 16:09:22.359366 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 211/411] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:22 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 28771 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:22.370002 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0cba06c9-b2b3-42b8-9628-9d825aea55ea tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:22.371185 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0cba06c9-b2b3-42b8-9628-9d825aea55ea tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:22.381331 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0cba06c9-b2b3-42b8-9628-9d825aea55ea tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:22.382050 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0cba06c9-b2b3-42b8-9628-9d825aea55ea tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:22.383444 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0cba06c9-b2b3-42b8-9628-9d825aea55ea tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:22.384065 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0cba06c9-b2b3-42b8-9628-9d825aea55ea tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:22.423522 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-15cd1924-5a3b-4923-bd14-4fbbb93ddfa0 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:22.424880 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-15cd1924-5a3b-4923-bd14-4fbbb93ddfa0 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:22.442517 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-15cd1924-5a3b-4923-bd14-4fbbb93ddfa0 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:22.443246 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-15cd1924-5a3b-4923-bd14-4fbbb93ddfa0 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:22.444185 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-15cd1924-5a3b-4923-bd14-4fbbb93ddfa0 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:22.444773 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-15cd1924-5a3b-4923-bd14-4fbbb93ddfa0 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:22.607109 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-15cd1924-5a3b-4923-bd14-4fbbb93ddfa0 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:22.619960 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-15cd1924-5a3b-4923-bd14-4fbbb93ddfa0 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 200 len: 1318 microversion: 2.1 time: 0.202158 Jul 30 16:09:22.620553 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 212/412] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:22 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:22.635160 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-19d772b9-19a3-44c5-ac4e-d241dba666d5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:22.641683 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-19d772b9-19a3-44c5-ac4e-d241dba666d5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:22.647596 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-19d772b9-19a3-44c5-ac4e-d241dba666d5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:22.648049 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-19d772b9-19a3-44c5-ac4e-d241dba666d5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:22.648821 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-19d772b9-19a3-44c5-ac4e-d241dba666d5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:22.649250 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-19d772b9-19a3-44c5-ac4e-d241dba666d5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:22.653381 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0cba06c9-b2b3-42b8-9628-9d825aea55ea tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:22.669078 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0cba06c9-b2b3-42b8-9628-9d825aea55ea tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.302905 Jul 30 16:09:22.670367 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 201/413] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:22 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:22.791596 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-19d772b9-19a3-44c5-ac4e-d241dba666d5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:22.801096 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-19d772b9-19a3-44c5-ac4e-d241dba666d5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1317 microversion: 2.1 time: 0.170307 Jul 30 16:09:22.802033 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 213/414] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:22 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:22.962140 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-cc46da4d-d501-4421-b10e-6ef367886142 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:22.964223 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-cc46da4d-d501-4421-b10e-6ef367886142 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:22.971873 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cc46da4d-d501-4421-b10e-6ef367886142 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:22.973094 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cc46da4d-d501-4421-b10e-6ef367886142 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:22.974529 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cc46da4d-d501-4421-b10e-6ef367886142 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:22.975296 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cc46da4d-d501-4421-b10e-6ef367886142 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:23.154093 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-cc46da4d-d501-4421-b10e-6ef367886142 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 28624 microversion: 2.20 time: 0.195959 Jul 30 16:09:23.159607 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 202/415] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:22 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 28624 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:23.365993 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0aa4f38e-dada-48c8-b5d4-3b7dafc63bc1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:23.367113 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0aa4f38e-dada-48c8-b5d4-3b7dafc63bc1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:23.373481 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0aa4f38e-dada-48c8-b5d4-3b7dafc63bc1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:23.373994 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0aa4f38e-dada-48c8-b5d4-3b7dafc63bc1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:23.375272 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0aa4f38e-dada-48c8-b5d4-3b7dafc63bc1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:23.376129 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0aa4f38e-dada-48c8-b5d4-3b7dafc63bc1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:23.502197 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0aa4f38e-dada-48c8-b5d4-3b7dafc63bc1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 29215 microversion: 2.1 time: 0.139826 Jul 30 16:09:23.502953 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 214/416] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:23 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 29215 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:23.643881 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a7f808d5-92b5-4db9-8397-dc7499d8c2d7 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:23.644855 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a7f808d5-92b5-4db9-8397-dc7499d8c2d7 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:23.654503 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a7f808d5-92b5-4db9-8397-dc7499d8c2d7 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:23.655651 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a7f808d5-92b5-4db9-8397-dc7499d8c2d7 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:23.656435 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a7f808d5-92b5-4db9-8397-dc7499d8c2d7 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:23.656876 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a7f808d5-92b5-4db9-8397-dc7499d8c2d7 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:23.686272 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4ccff1b7-6cb4-4e3a-9516-cca9c49b9c22 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:23.687544 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4ccff1b7-6cb4-4e3a-9516-cca9c49b9c22 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:23.694976 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4ccff1b7-6cb4-4e3a-9516-cca9c49b9c22 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:23.695719 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4ccff1b7-6cb4-4e3a-9516-cca9c49b9c22 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:23.697740 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4ccff1b7-6cb4-4e3a-9516-cca9c49b9c22 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:23.702128 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4ccff1b7-6cb4-4e3a-9516-cca9c49b9c22 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:23.887552 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4ccff1b7-6cb4-4e3a-9516-cca9c49b9c22 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:23.889964 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-a7f808d5-92b5-4db9-8397-dc7499d8c2d7 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:23.896869 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4ccff1b7-6cb4-4e3a-9516-cca9c49b9c22 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1501 microversion: 2.1 time: 0.214671 Jul 30 16:09:23.898138 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a7f808d5-92b5-4db9-8397-dc7499d8c2d7 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 200 len: 1318 microversion: 2.1 time: 0.262692 Jul 30 16:09:23.899179 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 203/417] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:23 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:23.906052 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9896b091-3b3d-42d7-8b82-aa8aef853b5e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:23.906862 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9896b091-3b3d-42d7-8b82-aa8aef853b5e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:23.907957 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 215/418] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:23 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1501 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:09:23.915248 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9896b091-3b3d-42d7-8b82-aa8aef853b5e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:23.915767 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9896b091-3b3d-42d7-8b82-aa8aef853b5e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:23.916571 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9896b091-3b3d-42d7-8b82-aa8aef853b5e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:23.917027 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9896b091-3b3d-42d7-8b82-aa8aef853b5e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:23.930817 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f3c90c5f-a9e9-4274-9ea8-2bca72f3e960 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a57336b-099b-4f31-9358-989840f8e454"}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:23.937783 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f3c90c5f-a9e9-4274-9ea8-2bca72f3e960 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:23.954588 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f3c90c5f-a9e9-4274-9ea8-2bca72f3e960 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:23.955234 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f3c90c5f-a9e9-4274-9ea8-2bca72f3e960 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:23.956399 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f3c90c5f-a9e9-4274-9ea8-2bca72f3e960 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:23.958935 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f3c90c5f-a9e9-4274-9ea8-2bca72f3e960 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:23.999540 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-f3c90c5f-a9e9-4274-9ea8-2bca72f3e960 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] HTTP exception thrown: Cannot 'attach_volume' instance f429942e-bf01-4d55-9cb0-29cdf5d6fef6 while it is in vm_state rescued Jul 30 16:09:24.000319 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f3c90c5f-a9e9-4274-9ea8-2bca72f3e960 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Returning 409 to user: Cannot 'attach_volume' instance f429942e-bf01-4d55-9cb0-29cdf5d6fef6 while it is in vm_state rescued {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:09:24.001317 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f3c90c5f-a9e9-4274-9ea8-2bca72f3e960 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "POST /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.078519 Jul 30 16:09:24.002040 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 216/419] 10.222.0.37 () {60 vars in 1323 bytes} [Fri Jul 30 16:09:23 2021] POST /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6/os-volume_attachments => generated 152 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 16:09:24.014893 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a40d6d8a-8532-4107-89ef-f115cd6b5e85 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:24.015545 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a40d6d8a-8532-4107-89ef-f115cd6b5e85 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:24.022198 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a40d6d8a-8532-4107-89ef-f115cd6b5e85 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:24.022652 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a40d6d8a-8532-4107-89ef-f115cd6b5e85 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:24.023583 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a40d6d8a-8532-4107-89ef-f115cd6b5e85 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:24.024077 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a40d6d8a-8532-4107-89ef-f115cd6b5e85 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:24.077632 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9896b091-3b3d-42d7-8b82-aa8aef853b5e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:24.085109 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9896b091-3b3d-42d7-8b82-aa8aef853b5e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1317 microversion: 2.1 time: 0.184719 Jul 30 16:09:24.085679 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 204/420] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:23 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:24.101420 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a40d6d8a-8532-4107-89ef-f115cd6b5e85 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "POST /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6/action" status: 202 len: 0 microversion: 2.1 time: 0.090389 Jul 30 16:09:24.102794 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 217/421] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:24 2021] POST /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:24.111890 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-95a7de26-d381-4e81-a78d-68e0ccd279fc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:24.112984 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-95a7de26-d381-4e81-a78d-68e0ccd279fc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:24.119652 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-95a7de26-d381-4e81-a78d-68e0ccd279fc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:24.120305 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-95a7de26-d381-4e81-a78d-68e0ccd279fc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:24.121090 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-95a7de26-d381-4e81-a78d-68e0ccd279fc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:24.121510 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-95a7de26-d381-4e81-a78d-68e0ccd279fc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:24.167056 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-55dcd806-6f2e-428b-8291-27e8bfe0b40f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:24.171704 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-55dcd806-6f2e-428b-8291-27e8bfe0b40f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:24.189659 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-55dcd806-6f2e-428b-8291-27e8bfe0b40f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:24.190121 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-55dcd806-6f2e-428b-8291-27e8bfe0b40f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:24.190922 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-55dcd806-6f2e-428b-8291-27e8bfe0b40f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:24.191541 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-55dcd806-6f2e-428b-8291-27e8bfe0b40f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:24.341825 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-55dcd806-6f2e-428b-8291-27e8bfe0b40f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 29113 microversion: 2.20 time: 0.179020 Jul 30 16:09:24.344528 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 218/422] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:24 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 29113 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:24.379605 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-95a7de26-d381-4e81-a78d-68e0ccd279fc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:24.390764 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-95a7de26-d381-4e81-a78d-68e0ccd279fc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1509 microversion: 2.1 time: 0.284530 Jul 30 16:09:24.396168 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 205/423] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:24 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1509 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:24.514834 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-aad8e099-5cb7-4c77-af4e-a640e0fb6a87 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:24.516546 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-aad8e099-5cb7-4c77-af4e-a640e0fb6a87 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:24.523694 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-aad8e099-5cb7-4c77-af4e-a640e0fb6a87 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:24.524388 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-aad8e099-5cb7-4c77-af4e-a640e0fb6a87 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:24.525337 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-aad8e099-5cb7-4c77-af4e-a640e0fb6a87 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:24.525925 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-aad8e099-5cb7-4c77-af4e-a640e0fb6a87 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:24.671032 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-aad8e099-5cb7-4c77-af4e-a640e0fb6a87 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 29733 microversion: 2.1 time: 0.160037 Jul 30 16:09:24.672316 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 219/424] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:24 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 29733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:09:24.915331 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ae4e21c6-1f47-464f-b7db-ab3417634428 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:24.915842 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ae4e21c6-1f47-464f-b7db-ab3417634428 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:24.925249 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ae4e21c6-1f47-464f-b7db-ab3417634428 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:24.925841 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ae4e21c6-1f47-464f-b7db-ab3417634428 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:24.926717 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ae4e21c6-1f47-464f-b7db-ab3417634428 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:24.927315 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ae4e21c6-1f47-464f-b7db-ab3417634428 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:25.102599 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-bf802bb7-ffdc-4090-9752-e84e40f0e8d0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:25.103237 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-bf802bb7-ffdc-4090-9752-e84e40f0e8d0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:25.110698 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bf802bb7-ffdc-4090-9752-e84e40f0e8d0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:25.111460 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bf802bb7-ffdc-4090-9752-e84e40f0e8d0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:25.112565 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bf802bb7-ffdc-4090-9752-e84e40f0e8d0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:25.113017 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bf802bb7-ffdc-4090-9752-e84e40f0e8d0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:25.138174 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-ae4e21c6-1f47-464f-b7db-ab3417634428 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:25.153586 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ae4e21c6-1f47-464f-b7db-ab3417634428 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 200 len: 1507 microversion: 2.1 time: 0.241906 Jul 30 16:09:25.154378 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 206/425] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:24 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:25.293623 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-bf802bb7-ffdc-4090-9752-e84e40f0e8d0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:25.301974 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-bf802bb7-ffdc-4090-9752-e84e40f0e8d0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1317 microversion: 2.1 time: 0.202996 Jul 30 16:09:25.302983 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 220/426] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:25 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:09:25.356862 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-35ff43a8-08d8-483d-ba4a-1440ce692e44 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:25.358004 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-35ff43a8-08d8-483d-ba4a-1440ce692e44 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:25.364621 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-35ff43a8-08d8-483d-ba4a-1440ce692e44 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:25.365358 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-35ff43a8-08d8-483d-ba4a-1440ce692e44 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:25.366235 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-35ff43a8-08d8-483d-ba4a-1440ce692e44 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:25.366937 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-35ff43a8-08d8-483d-ba4a-1440ce692e44 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:25.415356 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-7ebda526-a326-45b6-81b0-082bbe538cff tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:25.416442 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-7ebda526-a326-45b6-81b0-082bbe538cff tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:25.429157 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7ebda526-a326-45b6-81b0-082bbe538cff tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:25.431702 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7ebda526-a326-45b6-81b0-082bbe538cff tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:25.434198 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7ebda526-a326-45b6-81b0-082bbe538cff tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:25.435755 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7ebda526-a326-45b6-81b0-082bbe538cff tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:25.546932 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-35ff43a8-08d8-483d-ba4a-1440ce692e44 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 29777 microversion: 2.20 time: 0.194884 Jul 30 16:09:25.550899 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 207/427] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:25 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 29777 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:25.681052 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-036915d6-b262-41cc-8781-181384c25ecb req-6555ac75-cae3-4752-a5f4-5a5ed37ef7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449fc7f2-a7de-4c24-928e-9bd3294b773f", "name": "network-vif-plugged", "status": "completed", "tag": "52e600d7-de11-4a97-8436-e389bd5707d1"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:25.684100 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:09:25.684100 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:09:25.693572 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-036915d6-b262-41cc-8781-181384c25ecb req-6555ac75-cae3-4752-a5f4-5a5ed37ef7d9 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:25.694260 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-036915d6-b262-41cc-8781-181384c25ecb req-6555ac75-cae3-4752-a5f4-5a5ed37ef7d9 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:25.706680 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-036915d6-b262-41cc-8781-181384c25ecb req-6555ac75-cae3-4752-a5f4-5a5ed37ef7d9 service nova] Creating event network-vif-plugged:52e600d7-de11-4a97-8436-e389bd5707d1 for instance 449fc7f2-a7de-4c24-928e-9bd3294b773f on hv-cinder-80304 Jul 30 16:09:25.713047 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-036915d6-b262-41cc-8781-181384c25ecb req-6555ac75-cae3-4752-a5f4-5a5ed37ef7d9 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036205 Jul 30 16:09:25.714677 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 208/428] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:09:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:09:25.721738 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8f3b8469-9772-459d-a12f-dfeb4f0c7b26 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:25.722920 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8f3b8469-9772-459d-a12f-dfeb4f0c7b26 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:25.730042 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f3b8469-9772-459d-a12f-dfeb4f0c7b26 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:25.730771 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f3b8469-9772-459d-a12f-dfeb4f0c7b26 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:25.738954 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f3b8469-9772-459d-a12f-dfeb4f0c7b26 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:25.741671 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f3b8469-9772-459d-a12f-dfeb4f0c7b26 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:25.757713 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-7ebda526-a326-45b6-81b0-082bbe538cff tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:25.773766 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-7ebda526-a326-45b6-81b0-082bbe538cff tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1509 microversion: 2.1 time: 0.362905 Jul 30 16:09:25.784577 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 221/429] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:25 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1509 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:25.896789 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8f3b8469-9772-459d-a12f-dfeb4f0c7b26 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 30453 microversion: 2.1 time: 0.180230 Jul 30 16:09:25.897484 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 209/430] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:25 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 30453 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:26.317911 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-60fa786e-beef-4edf-b72f-3ad01391dece tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:26.318528 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-60fa786e-beef-4edf-b72f-3ad01391dece tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:26.335046 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-60fa786e-beef-4edf-b72f-3ad01391dece tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:26.336161 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-60fa786e-beef-4edf-b72f-3ad01391dece tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:26.337825 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-60fa786e-beef-4edf-b72f-3ad01391dece tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:26.338502 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-60fa786e-beef-4edf-b72f-3ad01391dece tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:26.560739 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0c15238c-1b23-4269-ba31-959895a90256 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:26.562437 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0c15238c-1b23-4269-ba31-959895a90256 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:26.569144 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0c15238c-1b23-4269-ba31-959895a90256 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:26.569596 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0c15238c-1b23-4269-ba31-959895a90256 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:26.570387 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0c15238c-1b23-4269-ba31-959895a90256 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:26.570827 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0c15238c-1b23-4269-ba31-959895a90256 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:26.621646 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-60fa786e-beef-4edf-b72f-3ad01391dece tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:26.629444 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-60fa786e-beef-4edf-b72f-3ad01391dece tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1317 microversion: 2.1 time: 0.315290 Jul 30 16:09:26.630019 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 222/431] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:26 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:26.690730 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0c15238c-1b23-4269-ba31-959895a90256 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 30353 microversion: 2.20 time: 0.135189 Jul 30 16:09:26.691502 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 210/432] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:26 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 30353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:26.792044 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-5b502677-be9b-4dc8-8528-254bd1f06d41 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:26.792648 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-5b502677-be9b-4dc8-8528-254bd1f06d41 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:26.807415 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5b502677-be9b-4dc8-8528-254bd1f06d41 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:26.807415 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5b502677-be9b-4dc8-8528-254bd1f06d41 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:26.807415 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5b502677-be9b-4dc8-8528-254bd1f06d41 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:26.807415 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5b502677-be9b-4dc8-8528-254bd1f06d41 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:26.914081 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-26105eeb-e1b4-4827-84c9-b1f1e5fdafe8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:26.916577 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-26105eeb-e1b4-4827-84c9-b1f1e5fdafe8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:26.926727 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-26105eeb-e1b4-4827-84c9-b1f1e5fdafe8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:26.927813 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-26105eeb-e1b4-4827-84c9-b1f1e5fdafe8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:26.929491 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-26105eeb-e1b4-4827-84c9-b1f1e5fdafe8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:26.930294 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-26105eeb-e1b4-4827-84c9-b1f1e5fdafe8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:27.058826 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-5b502677-be9b-4dc8-8528-254bd1f06d41 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:27.069455 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-26105eeb-e1b4-4827-84c9-b1f1e5fdafe8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 30948 microversion: 2.1 time: 0.160605 Jul 30 16:09:27.070454 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 211/433] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:26 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 30948 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:27.071361 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-5b502677-be9b-4dc8-8528-254bd1f06d41 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1509 microversion: 2.1 time: 0.281942 Jul 30 16:09:27.072132 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 223/434] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:26 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1509 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:27.649422 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-7c1387cb-5c7c-4b8b-8f17-c43ce5eac846 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:27.650789 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7c1387cb-5c7c-4b8b-8f17-c43ce5eac846 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:27.658817 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7c1387cb-5c7c-4b8b-8f17-c43ce5eac846 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:27.659315 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7c1387cb-5c7c-4b8b-8f17-c43ce5eac846 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:27.660092 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7c1387cb-5c7c-4b8b-8f17-c43ce5eac846 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:27.660533 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7c1387cb-5c7c-4b8b-8f17-c43ce5eac846 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:27.702999 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1ded97d7-4b4a-477b-8b15-d123511892d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:27.703950 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1ded97d7-4b4a-477b-8b15-d123511892d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:27.710821 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1ded97d7-4b4a-477b-8b15-d123511892d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:27.713954 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1ded97d7-4b4a-477b-8b15-d123511892d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:27.714979 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1ded97d7-4b4a-477b-8b15-d123511892d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:27.716254 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1ded97d7-4b4a-477b-8b15-d123511892d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:27.854336 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1ded97d7-4b4a-477b-8b15-d123511892d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 30879 microversion: 2.20 time: 0.153998 Jul 30 16:09:27.860252 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 224/435] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:27 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 30879 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:09:27.994484 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-7c1387cb-5c7c-4b8b-8f17-c43ce5eac846 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:28.002868 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-7c1387cb-5c7c-4b8b-8f17-c43ce5eac846 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1317 microversion: 2.1 time: 0.357512 Jul 30 16:09:28.006520 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 212/436] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:27 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:28.082848 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f48d1bd8-44ed-41d6-8f94-09bbbdab869c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:28.084152 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f48d1bd8-44ed-41d6-8f94-09bbbdab869c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:28.088604 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e3c57e15-8b69-4049-9696-290198ef33b1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:28.089425 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e3c57e15-8b69-4049-9696-290198ef33b1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:28.097200 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f48d1bd8-44ed-41d6-8f94-09bbbdab869c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:28.098478 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f48d1bd8-44ed-41d6-8f94-09bbbdab869c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:28.099353 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f48d1bd8-44ed-41d6-8f94-09bbbdab869c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:28.099787 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f48d1bd8-44ed-41d6-8f94-09bbbdab869c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:28.101355 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e3c57e15-8b69-4049-9696-290198ef33b1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:28.102001 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e3c57e15-8b69-4049-9696-290198ef33b1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:28.102957 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e3c57e15-8b69-4049-9696-290198ef33b1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:28.105168 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e3c57e15-8b69-4049-9696-290198ef33b1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:28.282356 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f48d1bd8-44ed-41d6-8f94-09bbbdab869c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 31411 microversion: 2.1 time: 0.203583 Jul 30 16:09:28.283013 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 225/437] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:28 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 31411 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:28.509798 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e3c57e15-8b69-4049-9696-290198ef33b1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:28.523829 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e3c57e15-8b69-4049-9696-290198ef33b1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1509 microversion: 2.1 time: 0.439135 Jul 30 16:09:28.524417 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 213/438] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:28 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1509 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:28.876477 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2724ce38-1958-461d-8e85-f7417c4ecc2c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:28.877757 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-2724ce38-1958-461d-8e85-f7417c4ecc2c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:28.886290 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2724ce38-1958-461d-8e85-f7417c4ecc2c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:28.887203 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2724ce38-1958-461d-8e85-f7417c4ecc2c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:28.889296 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2724ce38-1958-461d-8e85-f7417c4ecc2c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:28.889956 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2724ce38-1958-461d-8e85-f7417c4ecc2c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:29.026405 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-61e09f5e-101b-4c83-b2f1-3223be81caeb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:29.026945 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-61e09f5e-101b-4c83-b2f1-3223be81caeb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:29.038622 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61e09f5e-101b-4c83-b2f1-3223be81caeb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:29.038971 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61e09f5e-101b-4c83-b2f1-3223be81caeb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:29.039857 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61e09f5e-101b-4c83-b2f1-3223be81caeb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:29.040299 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61e09f5e-101b-4c83-b2f1-3223be81caeb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:29.146425 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2724ce38-1958-461d-8e85-f7417c4ecc2c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 31341 microversion: 2.20 time: 0.281476 Jul 30 16:09:29.151026 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 226/439] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:28 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 31341 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:29.297420 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d3b6c437-4b71-4b05-a903-5df421ffdea6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:29.300337 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d3b6c437-4b71-4b05-a903-5df421ffdea6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:29.316624 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d3b6c437-4b71-4b05-a903-5df421ffdea6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:29.320526 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d3b6c437-4b71-4b05-a903-5df421ffdea6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:29.323513 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d3b6c437-4b71-4b05-a903-5df421ffdea6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:29.324090 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d3b6c437-4b71-4b05-a903-5df421ffdea6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:29.471390 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d3b6c437-4b71-4b05-a903-5df421ffdea6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 31863 microversion: 2.1 time: 0.180238 Jul 30 16:09:29.472951 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 227/440] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:29 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 31863 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:29.534071 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-61e09f5e-101b-4c83-b2f1-3223be81caeb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:29.542568 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ad852fa1-4a1b-42fc-8284-d9c056f6c21b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:29.545627 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ad852fa1-4a1b-42fc-8284-d9c056f6c21b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:29.551608 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-61e09f5e-101b-4c83-b2f1-3223be81caeb tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1507 microversion: 2.1 time: 0.529095 Jul 30 16:09:29.552357 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 214/441] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:29 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1507 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:29.566143 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ad852fa1-4a1b-42fc-8284-d9c056f6c21b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:29.566806 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ad852fa1-4a1b-42fc-8284-d9c056f6c21b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:29.568250 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ad852fa1-4a1b-42fc-8284-d9c056f6c21b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:29.569126 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ad852fa1-4a1b-42fc-8284-d9c056f6c21b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:29.800877 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ad852fa1-4a1b-42fc-8284-d9c056f6c21b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:29.812894 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ad852fa1-4a1b-42fc-8284-d9c056f6c21b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1515 microversion: 2.1 time: 0.275120 Jul 30 16:09:29.813807 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 228/442] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:29 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1515 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:30.160300 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8fabb580-9cd3-47a8-bea5-96ea4d048a2a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:30.161311 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8fabb580-9cd3-47a8-bea5-96ea4d048a2a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:30.170052 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8fabb580-9cd3-47a8-bea5-96ea4d048a2a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:30.170594 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8fabb580-9cd3-47a8-bea5-96ea4d048a2a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:30.171407 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8fabb580-9cd3-47a8-bea5-96ea4d048a2a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:30.173922 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8fabb580-9cd3-47a8-bea5-96ea4d048a2a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:30.340241 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8fabb580-9cd3-47a8-bea5-96ea4d048a2a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 31806 microversion: 2.20 time: 0.183511 Jul 30 16:09:30.343165 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 215/443] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:30 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 31806 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:30.485838 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8a80508c-cddc-4c33-bf68-46efce467f35 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:30.486767 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-8a80508c-cddc-4c33-bf68-46efce467f35 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:30.494373 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8a80508c-cddc-4c33-bf68-46efce467f35 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:30.494989 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8a80508c-cddc-4c33-bf68-46efce467f35 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:30.495828 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8a80508c-cddc-4c33-bf68-46efce467f35 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:30.496272 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8a80508c-cddc-4c33-bf68-46efce467f35 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:30.661775 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8a80508c-cddc-4c33-bf68-46efce467f35 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 32339 microversion: 2.1 time: 0.181976 Jul 30 16:09:30.662686 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 229/444] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:30 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 32339 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:31.128216 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-dfaf1b9b-466a-414a-b22a-357b6743c75b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79c19071-bddb-43d9-95c0-f0253a903dde"}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:31.129536 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-dfaf1b9b-466a-414a-b22a-357b6743c75b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:31.146938 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dfaf1b9b-466a-414a-b22a-357b6743c75b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:31.147616 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dfaf1b9b-466a-414a-b22a-357b6743c75b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:31.148304 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dfaf1b9b-466a-414a-b22a-357b6743c75b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:31.148747 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dfaf1b9b-466a-414a-b22a-357b6743c75b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:31.337137 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-bef1c1c0-36a8-44b1-8b70-3bba274afbbb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:31.339458 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-bef1c1c0-36a8-44b1-8b70-3bba274afbbb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:31.354904 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bef1c1c0-36a8-44b1-8b70-3bba274afbbb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:31.355501 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bef1c1c0-36a8-44b1-8b70-3bba274afbbb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:31.356362 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bef1c1c0-36a8-44b1-8b70-3bba274afbbb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:31.356870 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bef1c1c0-36a8-44b1-8b70-3bba274afbbb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:31.550626 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-dfaf1b9b-466a-414a-b22a-357b6743c75b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "POST /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.427406 Jul 30 16:09:31.551880 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 216/445] 10.222.0.37 () {60 vars in 1323 bytes} [Fri Jul 30 16:09:31 2021] POST /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:09:31.565526 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ff7c4029-c821-4487-b9b6-c3cbe9485318 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:31.566813 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ff7c4029-c821-4487-b9b6-c3cbe9485318 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:31.578800 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-bef1c1c0-36a8-44b1-8b70-3bba274afbbb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:31.594349 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ff7c4029-c821-4487-b9b6-c3cbe9485318 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:31.594831 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ff7c4029-c821-4487-b9b6-c3cbe9485318 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:31.595655 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ff7c4029-c821-4487-b9b6-c3cbe9485318 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:31.596090 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ff7c4029-c821-4487-b9b6-c3cbe9485318 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:31.605562 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-bef1c1c0-36a8-44b1-8b70-3bba274afbbb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1515 microversion: 2.1 time: 0.271348 Jul 30 16:09:31.606853 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 230/446] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:31 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1515 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:31.622322 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2aa4a573-2b0d-423e-8d11-967f9b4210ca tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f42b4fc8-550c-4a0a-a678-2e5fa8aeecb8"}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:31.624162 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-2aa4a573-2b0d-423e-8d11-967f9b4210ca tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:31.642959 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2aa4a573-2b0d-423e-8d11-967f9b4210ca tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:31.647274 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2aa4a573-2b0d-423e-8d11-967f9b4210ca tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:31.661058 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2aa4a573-2b0d-423e-8d11-967f9b4210ca tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:31.664132 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2aa4a573-2b0d-423e-8d11-967f9b4210ca tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:31.893119 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ff7c4029-c821-4487-b9b6-c3cbe9485318 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 32294 microversion: 2.20 time: 0.332577 Jul 30 16:09:31.893789 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 217/447] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:31 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 32294 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:31.908174 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-70a2c630-b8ed-4401-a3c3-32fd709ea8af tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:31.909811 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-70a2c630-b8ed-4401-a3c3-32fd709ea8af tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:31.928225 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-70a2c630-b8ed-4401-a3c3-32fd709ea8af tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:31.929010 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-70a2c630-b8ed-4401-a3c3-32fd709ea8af tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:31.930024 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-70a2c630-b8ed-4401-a3c3-32fd709ea8af tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:31.930630 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-70a2c630-b8ed-4401-a3c3-32fd709ea8af tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:32.086572 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-70a2c630-b8ed-4401-a3c3-32fd709ea8af tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 32910 microversion: 2.1 time: 0.190996 Jul 30 16:09:32.087150 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 218/448] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:31 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 32910 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:32.164859 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2aa4a573-2b0d-423e-8d11-967f9b4210ca tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "POST /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.545823 Jul 30 16:09:32.165534 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 231/449] 10.222.0.37 () {60 vars in 1323 bytes} [Fri Jul 30 16:09:31 2021] POST /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6/os-volume_attachments => generated 194 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:09:32.906943 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a5c70943-1610-4da9-84a2-5649155cf5aa tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:32.908783 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a5c70943-1610-4da9-84a2-5649155cf5aa tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:32.916065 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a5c70943-1610-4da9-84a2-5649155cf5aa tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:32.916911 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a5c70943-1610-4da9-84a2-5649155cf5aa tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:32.917948 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a5c70943-1610-4da9-84a2-5649155cf5aa tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:32.918602 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a5c70943-1610-4da9-84a2-5649155cf5aa tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:33.073090 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a5c70943-1610-4da9-84a2-5649155cf5aa tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 32678 microversion: 2.20 time: 0.171075 Jul 30 16:09:33.078268 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 219/450] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:32 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 32678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:33.103201 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a6e47ee9-9f3e-44ce-bb20-837d78fd823f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:33.106343 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a6e47ee9-9f3e-44ce-bb20-837d78fd823f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:33.114589 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a6e47ee9-9f3e-44ce-bb20-837d78fd823f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:33.115360 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a6e47ee9-9f3e-44ce-bb20-837d78fd823f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:33.116675 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a6e47ee9-9f3e-44ce-bb20-837d78fd823f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:33.117253 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a6e47ee9-9f3e-44ce-bb20-837d78fd823f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:33.260978 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a6e47ee9-9f3e-44ce-bb20-837d78fd823f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 33286 microversion: 2.1 time: 0.164147 Jul 30 16:09:33.266947 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 232/451] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:33 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 33286 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:34.086000 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c5ffd0a4-6066-4de1-b48b-d4a9bcb2cb89 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:34.090138 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c5ffd0a4-6066-4de1-b48b-d4a9bcb2cb89 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:34.098227 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c5ffd0a4-6066-4de1-b48b-d4a9bcb2cb89 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:34.098768 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c5ffd0a4-6066-4de1-b48b-d4a9bcb2cb89 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:34.099777 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c5ffd0a4-6066-4de1-b48b-d4a9bcb2cb89 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:34.100374 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c5ffd0a4-6066-4de1-b48b-d4a9bcb2cb89 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:34.226819 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c5ffd0a4-6066-4de1-b48b-d4a9bcb2cb89 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 32976 microversion: 2.20 time: 0.144979 Jul 30 16:09:34.231633 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 220/452] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:34 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 32976 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:34.280176 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-260b5c11-a4dc-48b0-9828-02a2f5304494 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:34.282778 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-260b5c11-a4dc-48b0-9828-02a2f5304494 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:34.298263 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-260b5c11-a4dc-48b0-9828-02a2f5304494 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:34.299199 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-260b5c11-a4dc-48b0-9828-02a2f5304494 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:34.300589 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-260b5c11-a4dc-48b0-9828-02a2f5304494 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:34.301300 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-260b5c11-a4dc-48b0-9828-02a2f5304494 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:34.429896 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-260b5c11-a4dc-48b0-9828-02a2f5304494 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 33513 microversion: 2.1 time: 0.159521 Jul 30 16:09:34.435497 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 233/453] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:34 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 33513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:35.242754 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ca9afeb1-c909-42ba-89db-f818115b73a9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:35.242754 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ca9afeb1-c909-42ba-89db-f818115b73a9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:35.253996 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ca9afeb1-c909-42ba-89db-f818115b73a9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:35.255297 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ca9afeb1-c909-42ba-89db-f818115b73a9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:35.256866 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ca9afeb1-c909-42ba-89db-f818115b73a9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:35.257837 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ca9afeb1-c909-42ba-89db-f818115b73a9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:35.386941 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ca9afeb1-c909-42ba-89db-f818115b73a9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 33251 microversion: 2.20 time: 0.149751 Jul 30 16:09:35.388220 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 221/454] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:35 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 33251 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:35.446102 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-11185f9a-5269-4f8c-871b-66ecd3a7175a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:35.448322 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-11185f9a-5269-4f8c-871b-66ecd3a7175a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:35.460841 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-11185f9a-5269-4f8c-871b-66ecd3a7175a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:35.461696 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-11185f9a-5269-4f8c-871b-66ecd3a7175a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:35.463106 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-11185f9a-5269-4f8c-871b-66ecd3a7175a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:35.464348 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-11185f9a-5269-4f8c-871b-66ecd3a7175a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:35.603343 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-11185f9a-5269-4f8c-871b-66ecd3a7175a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 33806 microversion: 2.1 time: 0.162833 Jul 30 16:09:35.610386 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 234/455] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:35 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 33806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:36.403742 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-97afcbdd-464b-4447-a512-921bb337c1a0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:36.405946 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-97afcbdd-464b-4447-a512-921bb337c1a0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:36.413329 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-97afcbdd-464b-4447-a512-921bb337c1a0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:36.413785 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-97afcbdd-464b-4447-a512-921bb337c1a0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:36.414572 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-97afcbdd-464b-4447-a512-921bb337c1a0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:36.415007 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-97afcbdd-464b-4447-a512-921bb337c1a0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:36.529436 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-97afcbdd-464b-4447-a512-921bb337c1a0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 33596 microversion: 2.20 time: 0.131624 Jul 30 16:09:36.530987 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 222/456] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:36 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 33596 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:36.618352 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0b39aaa9-0704-4df0-acd3-835f4582bf6f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:36.619416 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0b39aaa9-0704-4df0-acd3-835f4582bf6f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:36.626596 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0b39aaa9-0704-4df0-acd3-835f4582bf6f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:36.627323 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0b39aaa9-0704-4df0-acd3-835f4582bf6f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:36.628334 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0b39aaa9-0704-4df0-acd3-835f4582bf6f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:36.628847 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0b39aaa9-0704-4df0-acd3-835f4582bf6f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:36.736424 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0b39aaa9-0704-4df0-acd3-835f4582bf6f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 34169 microversion: 2.1 time: 0.121931 Jul 30 16:09:36.737214 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 235/457] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:36 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 34169 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:37.543111 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-be2347ab-7a25-4370-8983-dd27b04506d8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:37.544160 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-be2347ab-7a25-4370-8983-dd27b04506d8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:37.554705 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-be2347ab-7a25-4370-8983-dd27b04506d8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:37.555073 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-be2347ab-7a25-4370-8983-dd27b04506d8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:37.558142 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-be2347ab-7a25-4370-8983-dd27b04506d8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:37.558834 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-be2347ab-7a25-4370-8983-dd27b04506d8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:37.673171 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-be2347ab-7a25-4370-8983-dd27b04506d8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 34014 microversion: 2.20 time: 0.133379 Jul 30 16:09:37.673503 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 223/458] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:37 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 34014 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:37.752447 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3959b8b6-6319-49dc-baf6-dda386eb5ed4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:37.753548 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-3959b8b6-6319-49dc-baf6-dda386eb5ed4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:37.761459 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3959b8b6-6319-49dc-baf6-dda386eb5ed4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:37.762001 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3959b8b6-6319-49dc-baf6-dda386eb5ed4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:37.762845 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3959b8b6-6319-49dc-baf6-dda386eb5ed4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:37.763469 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3959b8b6-6319-49dc-baf6-dda386eb5ed4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:37.886717 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-3959b8b6-6319-49dc-baf6-dda386eb5ed4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 34623 microversion: 2.1 time: 0.138547 Jul 30 16:09:37.892098 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 236/459] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:37 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 34623 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:38.687204 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3521aeb2-38ef-40f5-8f15-fb3ca287b78d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:38.688211 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3521aeb2-38ef-40f5-8f15-fb3ca287b78d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:38.695643 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3521aeb2-38ef-40f5-8f15-fb3ca287b78d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:38.696739 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3521aeb2-38ef-40f5-8f15-fb3ca287b78d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:38.700335 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3521aeb2-38ef-40f5-8f15-fb3ca287b78d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:38.702923 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3521aeb2-38ef-40f5-8f15-fb3ca287b78d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:38.821435 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3521aeb2-38ef-40f5-8f15-fb3ca287b78d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 34488 microversion: 2.20 time: 0.138495 Jul 30 16:09:38.822790 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 224/460] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:38 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 34488 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:38.899878 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-63ecc65e-8f4a-4d9c-88f9-c2b9bb9b4d4f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:38.900879 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-63ecc65e-8f4a-4d9c-88f9-c2b9bb9b4d4f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:38.909951 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-63ecc65e-8f4a-4d9c-88f9-c2b9bb9b4d4f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:38.910451 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-63ecc65e-8f4a-4d9c-88f9-c2b9bb9b4d4f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:38.911502 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-63ecc65e-8f4a-4d9c-88f9-c2b9bb9b4d4f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:38.912010 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-63ecc65e-8f4a-4d9c-88f9-c2b9bb9b4d4f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:39.024310 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-63ecc65e-8f4a-4d9c-88f9-c2b9bb9b4d4f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 34885 microversion: 2.1 time: 0.127918 Jul 30 16:09:39.025035 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 237/461] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:38 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 34885 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:39.833703 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-dd32aa85-8e7a-44e6-b69f-7d9e8a7639b5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:39.838063 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-dd32aa85-8e7a-44e6-b69f-7d9e8a7639b5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:39.845740 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dd32aa85-8e7a-44e6-b69f-7d9e8a7639b5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:39.846196 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dd32aa85-8e7a-44e6-b69f-7d9e8a7639b5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:39.847166 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dd32aa85-8e7a-44e6-b69f-7d9e8a7639b5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:39.847778 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dd32aa85-8e7a-44e6-b69f-7d9e8a7639b5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:39.966508 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-dd32aa85-8e7a-44e6-b69f-7d9e8a7639b5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 34948 microversion: 2.20 time: 0.136672 Jul 30 16:09:39.969458 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 225/462] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:39 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 34948 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:40.037642 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9fa2e2dd-38a8-429c-9de5-f869ffe11a50 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:40.039344 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9fa2e2dd-38a8-429c-9de5-f869ffe11a50 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:40.047092 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9fa2e2dd-38a8-429c-9de5-f869ffe11a50 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:40.047512 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9fa2e2dd-38a8-429c-9de5-f869ffe11a50 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:40.048456 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9fa2e2dd-38a8-429c-9de5-f869ffe11a50 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:40.049039 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9fa2e2dd-38a8-429c-9de5-f869ffe11a50 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:40.145700 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9fa2e2dd-38a8-429c-9de5-f869ffe11a50 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 35151 microversion: 2.1 time: 0.112374 Jul 30 16:09:40.149856 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 238/463] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:40 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 35151 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:40.250206 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-11ef2fd5-043e-41d0-ac9e-94dfc727e569 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Action: 'create', calling method: .version_select at 0x7fb17ecc7940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-31089851"}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:40.269377 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-11ef2fd5-043e-41d0-ac9e-94dfc727e569 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Getting quotas for project f36597e2839440af8e51082842f1d063. Resources: {'key_pairs'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:09:40.274932 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-11ef2fd5-043e-41d0-ac9e-94dfc727e569 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Getting quotas for user 3c7fb206da5e46bfaff79505e5029132 and project f36597e2839440af8e51082842f1d063. Resources: {'key_pairs'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:09:40.336847 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-10e8a9d5-aa9c-4df7-82da-a560a5da71f0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79c19071-bddb-43d9-95c0-f0253a903dde"}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:40.337980 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-10e8a9d5-aa9c-4df7-82da-a560a5da71f0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:40.345448 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-10e8a9d5-aa9c-4df7-82da-a560a5da71f0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:40.347442 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-10e8a9d5-aa9c-4df7-82da-a560a5da71f0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:40.348373 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-10e8a9d5-aa9c-4df7-82da-a560a5da71f0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:40.348859 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-10e8a9d5-aa9c-4df7-82da-a560a5da71f0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:40.434891 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-10e8a9d5-aa9c-4df7-82da-a560a5da71f0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] HTTP exception thrown: Invalid volume: volume 79c19071-bddb-43d9-95c0-f0253a903dde is already attached to instances: 449fc7f2-a7de-4c24-928e-9bd3294b773f Jul 30 16:09:40.435529 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-10e8a9d5-aa9c-4df7-82da-a560a5da71f0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Returning 400 to user: Invalid volume: volume 79c19071-bddb-43d9-95c0-f0253a903dde is already attached to instances: 449fc7f2-a7de-4c24-928e-9bd3294b773f {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:09:40.436618 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-10e8a9d5-aa9c-4df7-82da-a560a5da71f0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "POST /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106399 Jul 30 16:09:40.440429 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 239/464] 10.222.0.37 () {60 vars in 1323 bytes} [Fri Jul 30 16:09:40 2021] POST /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 16:09:40.503477 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b4b54072-f2ed-4b7d-9729-eabd75be6116 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:40.503975 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b4b54072-f2ed-4b7d-9729-eabd75be6116 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:40.509881 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b4b54072-f2ed-4b7d-9729-eabd75be6116 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:40.510331 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b4b54072-f2ed-4b7d-9729-eabd75be6116 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:40.511096 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b4b54072-f2ed-4b7d-9729-eabd75be6116 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:40.511560 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b4b54072-f2ed-4b7d-9729-eabd75be6116 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:40.637701 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.objects.instance [None req-b4b54072-f2ed-4b7d-9729-eabd75be6116 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lazy-loading 'services' on Instance uuid 449fc7f2-a7de-4c24-928e-9bd3294b773f {{(pid=107453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:09:40.742536 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-11ef2fd5-043e-41d0-ac9e-94dfc727e569 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Getting quotas for project f36597e2839440af8e51082842f1d063. Resources: {'key_pairs'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:09:40.745015 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b4b54072-f2ed-4b7d-9729-eabd75be6116 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "DELETE /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f/os-volume_attachments/79c19071-bddb-43d9-95c0-f0253a903dde" status: 202 len: 0 microversion: 2.1 time: 0.245245 Jul 30 16:09:40.746407 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-11ef2fd5-043e-41d0-ac9e-94dfc727e569 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Getting quotas for user 3c7fb206da5e46bfaff79505e5029132 and project f36597e2839440af8e51082842f1d063. Resources: {'key_pairs'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:09:40.746642 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 240/465] 10.222.0.37 () {58 vars in 1416 bytes} [Fri Jul 30 16:09:40 2021] DELETE /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f/os-volume_attachments/79c19071-bddb-43d9-95c0-f0253a903dde => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:40.759836 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-11ef2fd5-043e-41d0-ac9e-94dfc727e569 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.513794 Jul 30 16:09:40.760430 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 226/466] 10.222.0.37 () {60 vars in 1158 bytes} [Fri Jul 30 16:09:40 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:40.813872 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-42327ffe-d51f-458c-b6da-51748bd87399 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1422905385", "imageRef": "f9d1321f-7f9b-43ad-b715-6632dd5bfa56", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-31089851", "networks": [{"uuid": "a37cfa62-9287-4d80-bfce-7ec0f55f0671"}]}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:40.882287 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.network.neutron [None req-42327ffe-d51f-458c-b6da-51748bd87399 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] validate_networks() for [('a37cfa62-9287-4d80-bfce-7ec0f55f0671', None, None, None)] {{(pid=107453) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:09:40.979511 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f600b051-0b00-48c8-8ca9-22a8c7e51a5b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:40.980551 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f600b051-0b00-48c8-8ca9-22a8c7e51a5b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:40.986796 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f600b051-0b00-48c8-8ca9-22a8c7e51a5b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:40.987295 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f600b051-0b00-48c8-8ca9-22a8c7e51a5b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:40.988078 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f600b051-0b00-48c8-8ca9-22a8c7e51a5b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:40.988518 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f600b051-0b00-48c8-8ca9-22a8c7e51a5b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:41.109265 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f600b051-0b00-48c8-8ca9-22a8c7e51a5b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 35292 microversion: 2.20 time: 0.133235 Jul 30 16:09:41.113757 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 227/467] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:40 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 35292 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:09:41.158539 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1827a317-6481-40c9-8b01-1f80bcbd542d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:41.159572 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1827a317-6481-40c9-8b01-1f80bcbd542d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:41.166095 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1827a317-6481-40c9-8b01-1f80bcbd542d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:41.166662 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1827a317-6481-40c9-8b01-1f80bcbd542d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:41.167356 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1827a317-6481-40c9-8b01-1f80bcbd542d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:41.167799 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1827a317-6481-40c9-8b01-1f80bcbd542d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:41.247822 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-42327ffe-d51f-458c-b6da-51748bd87399 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Flavor limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:09:41.248354 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-42327ffe-d51f-458c-b6da-51748bd87399 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Image limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:09:41.248862 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-42327ffe-d51f-458c-b6da-51748bd87399 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Flavor pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:09:41.249249 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-42327ffe-d51f-458c-b6da-51748bd87399 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Image pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:09:41.249675 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-42327ffe-d51f-458c-b6da-51748bd87399 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:09:41.258998 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-42327ffe-d51f-458c-b6da-51748bd87399 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:41.259470 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-42327ffe-d51f-458c-b6da-51748bd87399 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:41.260265 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-42327ffe-d51f-458c-b6da-51748bd87399 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:41.260692 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-42327ffe-d51f-458c-b6da-51748bd87399 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:41.278771 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-42327ffe-d51f-458c-b6da-51748bd87399 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Getting quotas for project f36597e2839440af8e51082842f1d063. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:09:41.283633 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1827a317-6481-40c9-8b01-1f80bcbd542d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 35547 microversion: 2.1 time: 0.129459 Jul 30 16:09:41.287929 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-42327ffe-d51f-458c-b6da-51748bd87399 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Getting quotas for user 3c7fb206da5e46bfaff79505e5029132 and project f36597e2839440af8e51082842f1d063. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:09:41.288113 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 228/468] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:41 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 35547 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:41.295192 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-42327ffe-d51f-458c-b6da-51748bd87399 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Going to run 1 instances... {{(pid=107453) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:09:41.297489 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-42327ffe-d51f-458c-b6da-51748bd87399 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9d1321f-7f9b-43ad-b715-6632dd5bfa56',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:09:41.340811 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-42327ffe-d51f-458c-b6da-51748bd87399 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532896 Jul 30 16:09:41.341440 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 241/469] 10.222.0.37 () {60 vars in 1147 bytes} [Fri Jul 30 16:09:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 16:09:41.351719 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-cb671000-5088-4c57-a324-55f15823d674 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:41.352585 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-cb671000-5088-4c57-a324-55f15823d674 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:41.405551 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-cb671000-5088-4c57-a324-55f15823d674 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:41.412040 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-cb671000-5088-4c57-a324-55f15823d674 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1257 microversion: 2.1 time: 0.064363 Jul 30 16:09:41.412854 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 229/470] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:41 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1257 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:42.121969 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-5cd89645-b53c-4b7d-814b-73a22307e9d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:42.122941 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-5cd89645-b53c-4b7d-814b-73a22307e9d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:42.129648 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5cd89645-b53c-4b7d-814b-73a22307e9d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:42.130029 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5cd89645-b53c-4b7d-814b-73a22307e9d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:42.130817 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5cd89645-b53c-4b7d-814b-73a22307e9d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:42.131275 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5cd89645-b53c-4b7d-814b-73a22307e9d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:42.231883 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-5cd89645-b53c-4b7d-814b-73a22307e9d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 35671 microversion: 2.20 time: 0.113970 Jul 30 16:09:42.232597 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 242/471] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:42 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 35671 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:09:42.296182 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-eb0b5672-2013-4d46-a946-32cb54f0506d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:42.297096 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-eb0b5672-2013-4d46-a946-32cb54f0506d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:42.304024 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-eb0b5672-2013-4d46-a946-32cb54f0506d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:42.304477 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-eb0b5672-2013-4d46-a946-32cb54f0506d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:42.305251 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-eb0b5672-2013-4d46-a946-32cb54f0506d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:42.305684 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-eb0b5672-2013-4d46-a946-32cb54f0506d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:42.414847 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-eb0b5672-2013-4d46-a946-32cb54f0506d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 36001 microversion: 2.1 time: 0.122685 Jul 30 16:09:42.415681 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 230/472] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:42 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 36001 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:09:42.430336 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b02d2f53-773b-46e4-b5e9-5a25c8b77935 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:09:42.431039 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b02d2f53-773b-46e4-b5e9-5a25c8b77935 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:42.437546 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b02d2f53-773b-46e4-b5e9-5a25c8b77935 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:42.437996 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b02d2f53-773b-46e4-b5e9-5a25c8b77935 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:42.438759 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b02d2f53-773b-46e4-b5e9-5a25c8b77935 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:42.439215 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b02d2f53-773b-46e4-b5e9-5a25c8b77935 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:42.502221 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b02d2f53-773b-46e4-b5e9-5a25c8b77935 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:09:42.509567 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b02d2f53-773b-46e4-b5e9-5a25c8b77935 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1309 microversion: 2.1 time: 0.083226 Jul 30 16:09:42.510117 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 243/473] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:09:42 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1309 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:09:43.244876 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-95829321-0681-4ff6-95fa-e4700ae97d60 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:43.245860 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-95829321-0681-4ff6-95fa-e4700ae97d60 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:43.253252 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-95829321-0681-4ff6-95fa-e4700ae97d60 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:43.253701 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-95829321-0681-4ff6-95fa-e4700ae97d60 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:43.254482 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-95829321-0681-4ff6-95fa-e4700ae97d60 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:43.254912 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-95829321-0681-4ff6-95fa-e4700ae97d60 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:43.427583 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f09b14f9-b2a9-4ad3-a216-1deb56c6127e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:09:43.428851 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f09b14f9-b2a9-4ad3-a216-1deb56c6127e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:09:43.437015 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f09b14f9-b2a9-4ad3-a216-1deb56c6127e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:43.438791 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f09b14f9-b2a9-4ad3-a216-1deb56c6127e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:09:43.440865 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f09b14f9-b2a9-4ad3-a216-1deb56c6127e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:09:43.441522 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f09b14f9-b2a9-4ad3-a216-1deb56c6127e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:13.365263 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-95829321-0681-4ff6-95fa-e4700ae97d60 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 200 len: 38187 microversion: 2.20 time: 30.124279 Jul 30 16:10:13.366036 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 231/474] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:09:43 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 38187 bytes in 30126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:10:13.370774 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-99364a21-feaa-4075-9c84-05b4bd654511 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:13.371487 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-99364a21-feaa-4075-9c84-05b4bd654511 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:13.378670 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-99364a21-feaa-4075-9c84-05b4bd654511 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:13.379118 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-99364a21-feaa-4075-9c84-05b4bd654511 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:13.379914 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-99364a21-feaa-4075-9c84-05b4bd654511 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:13.380375 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-99364a21-feaa-4075-9c84-05b4bd654511 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:13.461150 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f09b14f9-b2a9-4ad3-a216-1deb56c6127e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 200 len: 38200 microversion: 2.1 time: 30.037960 Jul 30 16:10:13.462178 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 244/475] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:09:43 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 38200 bytes in 30040 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:10:13.467316 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8127a12b-e6d7-4361-9a52-f96a76fed8a3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cec09d66-f1e4-4019-a648-50c7401c0f10", "device": "/dev/sdb"}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:10:13.468963 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-8127a12b-e6d7-4361-9a52-f96a76fed8a3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:13.475404 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8127a12b-e6d7-4361-9a52-f96a76fed8a3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:13.475854 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8127a12b-e6d7-4361-9a52-f96a76fed8a3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:13.476623 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8127a12b-e6d7-4361-9a52-f96a76fed8a3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:13.477083 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8127a12b-e6d7-4361-9a52-f96a76fed8a3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:13.649113 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-99364a21-feaa-4075-9c84-05b4bd654511 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:13.680571 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-99364a21-feaa-4075-9c84-05b4bd654511 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1357 microversion: 2.1 time: 0.313069 Jul 30 16:10:13.687474 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 232/476] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:13 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1357 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:13.693493 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-4cd3d2f6-ced9-4ebe-9a79-7b93bb7932f3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:13.697592 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-4cd3d2f6-ced9-4ebe-9a79-7b93bb7932f3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:13.712244 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4cd3d2f6-ced9-4ebe-9a79-7b93bb7932f3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:13.713239 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4cd3d2f6-ced9-4ebe-9a79-7b93bb7932f3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:13.714330 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4cd3d2f6-ced9-4ebe-9a79-7b93bb7932f3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:13.715249 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4cd3d2f6-ced9-4ebe-9a79-7b93bb7932f3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:13.755519 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-4cd3d2f6-ced9-4ebe-9a79-7b93bb7932f3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/ips" status: 200 len: 150 microversion: 2.20 time: 0.071880 Jul 30 16:10:13.761956 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 233/477] 10.222.0.37 () {60 vars in 1289 bytes} [Fri Jul 30 16:10:13 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/ips => generated 150 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:10:13.761956 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-59a8ff32-43e9-4786-991e-a28183d7701c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:13.767435 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-59a8ff32-43e9-4786-991e-a28183d7701c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:13.775330 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59a8ff32-43e9-4786-991e-a28183d7701c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:13.776013 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59a8ff32-43e9-4786-991e-a28183d7701c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:13.776896 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59a8ff32-43e9-4786-991e-a28183d7701c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:13.777540 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59a8ff32-43e9-4786-991e-a28183d7701c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:13.826456 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8127a12b-e6d7-4361-9a52-f96a76fed8a3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "POST /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362857 Jul 30 16:10:13.827426 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 245/478] 10.222.0.37 () {60 vars in 1323 bytes} [Fri Jul 30 16:10:13 2021] POST /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:10:13.834329 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-59a8ff32-43e9-4786-991e-a28183d7701c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/ips" status: 200 len: 145 microversion: 2.1 time: 0.076890 Jul 30 16:10:13.835069 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 234/479] 10.222.0.37 () {58 vars in 1248 bytes} [Fri Jul 30 16:10:13 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/ips => generated 145 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:10:14.200431 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-c39e1f20-b16f-459d-acec-9b7921bda50d req-80144742-a52d-4272-acac-95cb0fa4ee38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb0becf-8d14-4c6b-8b46-82c09b52a5a6", "tag": "be55314f-44d9-47f6-87fd-5d73fbe32ff7"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:10:14.202587 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:10:14.202587 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:10:14.214534 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-c39e1f20-b16f-459d-acec-9b7921bda50d req-80144742-a52d-4272-acac-95cb0fa4ee38 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:14.214968 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-c39e1f20-b16f-459d-acec-9b7921bda50d req-80144742-a52d-4272-acac-95cb0fa4ee38 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:14.235355 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-c39e1f20-b16f-459d-acec-9b7921bda50d req-80144742-a52d-4272-acac-95cb0fa4ee38 service nova] Creating event network-changed:be55314f-44d9-47f6-87fd-5d73fbe32ff7 for instance 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 on hv-cinder-80304 Jul 30 16:10:14.241373 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-c39e1f20-b16f-459d-acec-9b7921bda50d req-80144742-a52d-4272-acac-95cb0fa4ee38 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044828 Jul 30 16:10:14.242654 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 246/480] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:10:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:10:14.699778 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8e40503b-1dc7-400e-b012-2962b3d1a3b1 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:14.700390 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8e40503b-1dc7-400e-b012-2962b3d1a3b1 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:14.707624 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8e40503b-1dc7-400e-b012-2962b3d1a3b1 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:14.708081 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8e40503b-1dc7-400e-b012-2962b3d1a3b1 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:14.708855 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8e40503b-1dc7-400e-b012-2962b3d1a3b1 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:14.709288 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8e40503b-1dc7-400e-b012-2962b3d1a3b1 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:14.858039 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8e40503b-1dc7-400e-b012-2962b3d1a3b1 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:14.865260 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8e40503b-1dc7-400e-b012-2962b3d1a3b1 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1357 microversion: 2.1 time: 0.169313 Jul 30 16:10:14.865832 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 235/481] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:14 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:15.865971 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2989537d-6abe-4575-a269-aed384bdc2bd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:10:15.867011 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-2989537d-6abe-4575-a269-aed384bdc2bd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:15.873494 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2989537d-6abe-4575-a269-aed384bdc2bd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:15.874016 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2989537d-6abe-4575-a269-aed384bdc2bd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:15.874787 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2989537d-6abe-4575-a269-aed384bdc2bd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:15.875319 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2989537d-6abe-4575-a269-aed384bdc2bd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:15.881670 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-53b0028e-59b8-4455-81de-bd70e7b0a5d0 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:15.882288 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-53b0028e-59b8-4455-81de-bd70e7b0a5d0 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:15.888092 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-53b0028e-59b8-4455-81de-bd70e7b0a5d0 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:15.889208 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-53b0028e-59b8-4455-81de-bd70e7b0a5d0 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:15.890247 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-53b0028e-59b8-4455-81de-bd70e7b0a5d0 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:15.890693 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-53b0028e-59b8-4455-81de-bd70e7b0a5d0 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:15.898413 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.objects.instance [None req-2989537d-6abe-4575-a269-aed384bdc2bd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lazy-loading 'flavor' on Instance uuid f429942e-bf01-4d55-9cb0-29cdf5d6fef6 {{(pid=107453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:10:16.018996 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-53b0028e-59b8-4455-81de-bd70e7b0a5d0 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:16.029781 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-53b0028e-59b8-4455-81de-bd70e7b0a5d0 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1357 microversion: 2.1 time: 0.151037 Jul 30 16:10:16.030798 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 236/482] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:15 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:16.042206 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2989537d-6abe-4575-a269-aed384bdc2bd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "POST /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6/action" status: 200 len: 32 microversion: 2.1 time: 0.180743 Jul 30 16:10:16.042824 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 247/483] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:10:15 2021] POST /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6/action => generated 32 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:10:16.052016 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0816c09a-901a-4507-ba76-fa4cae235a29 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:16.052621 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0816c09a-901a-4507-ba76-fa4cae235a29 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:16.058464 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0816c09a-901a-4507-ba76-fa4cae235a29 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:16.058900 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0816c09a-901a-4507-ba76-fa4cae235a29 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:16.059706 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0816c09a-901a-4507-ba76-fa4cae235a29 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:16.060211 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0816c09a-901a-4507-ba76-fa4cae235a29 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:16.205529 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0816c09a-901a-4507-ba76-fa4cae235a29 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:16.213264 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0816c09a-901a-4507-ba76-fa4cae235a29 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.164784 Jul 30 16:10:16.213836 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 237/484] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:16 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:17.049894 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1c7dfc6e-d8b1-46ff-932a-e1eadca1c5e8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:17.050531 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1c7dfc6e-d8b1-46ff-932a-e1eadca1c5e8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:17.057326 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1c7dfc6e-d8b1-46ff-932a-e1eadca1c5e8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:17.057784 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1c7dfc6e-d8b1-46ff-932a-e1eadca1c5e8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:17.058570 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1c7dfc6e-d8b1-46ff-932a-e1eadca1c5e8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:17.059387 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1c7dfc6e-d8b1-46ff-932a-e1eadca1c5e8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:17.151417 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-69c6e5d4-37ea-440d-bb8f-74816f98291a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:10:17.152057 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-69c6e5d4-37ea-440d-bb8f-74816f98291a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:17.159483 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-69c6e5d4-37ea-440d-bb8f-74816f98291a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:17.160018 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-69c6e5d4-37ea-440d-bb8f-74816f98291a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:17.160867 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-69c6e5d4-37ea-440d-bb8f-74816f98291a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:17.161374 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-69c6e5d4-37ea-440d-bb8f-74816f98291a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:17.184375 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.objects.instance [None req-69c6e5d4-37ea-440d-bb8f-74816f98291a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lazy-loading 'flavor' on Instance uuid ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb {{(pid=107452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:10:17.188817 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1c7dfc6e-d8b1-46ff-932a-e1eadca1c5e8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:17.196358 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1c7dfc6e-d8b1-46ff-932a-e1eadca1c5e8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1357 microversion: 2.1 time: 0.152329 Jul 30 16:10:17.196912 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 248/485] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:17 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:17.230427 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-541f0642-b93b-4e4f-a01a-f16b659b6c81 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:17.231035 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-541f0642-b93b-4e4f-a01a-f16b659b6c81 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:17.238042 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-541f0642-b93b-4e4f-a01a-f16b659b6c81 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:17.238721 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-541f0642-b93b-4e4f-a01a-f16b659b6c81 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:17.239540 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-541f0642-b93b-4e4f-a01a-f16b659b6c81 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:17.240145 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-541f0642-b93b-4e4f-a01a-f16b659b6c81 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:17.365283 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-541f0642-b93b-4e4f-a01a-f16b659b6c81 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:17.373363 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-541f0642-b93b-4e4f-a01a-f16b659b6c81 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.146470 Jul 30 16:10:17.373914 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 249/486] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:17 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:17.454188 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-69c6e5d4-37ea-440d-bb8f-74816f98291a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 202 len: 0 microversion: 2.20 time: 0.306266 Jul 30 16:10:17.454800 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 238/487] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:10:17 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 30 16:10:17.462912 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b7dcb146-f9a8-4517-b11c-caf08e85a3e8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:17.463647 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b7dcb146-f9a8-4517-b11c-caf08e85a3e8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:17.470654 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b7dcb146-f9a8-4517-b11c-caf08e85a3e8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:17.471054 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b7dcb146-f9a8-4517-b11c-caf08e85a3e8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:17.471888 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b7dcb146-f9a8-4517-b11c-caf08e85a3e8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:17.472363 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b7dcb146-f9a8-4517-b11c-caf08e85a3e8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:17.578151 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e5394a4d-0959-43f7-871d-64944bf3fbea tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62b48b20-05f2-414a-a5ee-21b4572f7023"}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:10:17.579332 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e5394a4d-0959-43f7-871d-64944bf3fbea tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:17.585518 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e5394a4d-0959-43f7-871d-64944bf3fbea tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:17.585970 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e5394a4d-0959-43f7-871d-64944bf3fbea tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:17.586748 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e5394a4d-0959-43f7-871d-64944bf3fbea tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:17.587210 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e5394a4d-0959-43f7-871d-64944bf3fbea tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:17.601669 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b7dcb146-f9a8-4517-b11c-caf08e85a3e8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:17.610186 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b7dcb146-f9a8-4517-b11c-caf08e85a3e8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:17.611883 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b7dcb146-f9a8-4517-b11c-caf08e85a3e8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:17.613301 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b7dcb146-f9a8-4517-b11c-caf08e85a3e8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.154016 Jul 30 16:10:17.618311 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 250/488] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:17 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:17.862821 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e5394a4d-0959-43f7-871d-64944bf3fbea tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288817 Jul 30 16:10:17.863445 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 239/489] 10.222.0.37 () {60 vars in 1323 bytes} [Fri Jul 30 16:10:17 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:10:18.002007 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-5f4d5be3-9a7b-4957-a3e6-0e6a6f02ea40 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-608701274", "imageRef": "eea29a7d-10c3-489a-adee-10be2e7a26bd", "flavorRef": "452", "networks": [{"uuid": "9a836950-de83-4064-be6b-b98de3093a5e"}]}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:10:18.058816 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.network.neutron [None req-5f4d5be3-9a7b-4957-a3e6-0e6a6f02ea40 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] validate_networks() for [('9a836950-de83-4064-be6b-b98de3093a5e', None, None, None)] {{(pid=107453) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:10:18.214058 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ed1b963c-6d41-43bf-a07d-38a92889eb2c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:18.214884 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ed1b963c-6d41-43bf-a07d-38a92889eb2c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:18.221465 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ed1b963c-6d41-43bf-a07d-38a92889eb2c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:18.221995 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ed1b963c-6d41-43bf-a07d-38a92889eb2c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:18.222841 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ed1b963c-6d41-43bf-a07d-38a92889eb2c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:18.223324 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ed1b963c-6d41-43bf-a07d-38a92889eb2c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:18.242304 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 16:10:18.242852 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: Fri Jul 30 16:10:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.37) !!! Jul 30 16:10:18.365206 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-ed1b963c-6d41-43bf-a07d-38a92889eb2c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:18.374933 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ed1b963c-6d41-43bf-a07d-38a92889eb2c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1357 microversion: 2.1 time: 0.164819 Jul 30 16:10:18.375565 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 240/490] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:18 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:18.390005 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-bf8bc99c-9b76-47d6-9a18-2502ed57a346 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:18.390951 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-bf8bc99c-9b76-47d6-9a18-2502ed57a346 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:18.398080 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bf8bc99c-9b76-47d6-9a18-2502ed57a346 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:18.398644 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bf8bc99c-9b76-47d6-9a18-2502ed57a346 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:18.399561 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bf8bc99c-9b76-47d6-9a18-2502ed57a346 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:18.400144 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bf8bc99c-9b76-47d6-9a18-2502ed57a346 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:18.454068 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-5f4d5be3-9a7b-4957-a3e6-0e6a6f02ea40 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Flavor limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:10:18.454494 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-5f4d5be3-9a7b-4957-a3e6-0e6a6f02ea40 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Image limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:10:18.454968 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-5f4d5be3-9a7b-4957-a3e6-0e6a6f02ea40 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Flavor pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:10:18.455408 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-5f4d5be3-9a7b-4957-a3e6-0e6a6f02ea40 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Image pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:10:18.455849 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-5f4d5be3-9a7b-4957-a3e6-0e6a6f02ea40 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:10:18.464734 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5f4d5be3-9a7b-4957-a3e6-0e6a6f02ea40 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:18.465182 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5f4d5be3-9a7b-4957-a3e6-0e6a6f02ea40 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:18.465991 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5f4d5be3-9a7b-4957-a3e6-0e6a6f02ea40 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:18.466460 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5f4d5be3-9a7b-4957-a3e6-0e6a6f02ea40 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:18.483222 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-5f4d5be3-9a7b-4957-a3e6-0e6a6f02ea40 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Getting quotas for project e9b01b7e6d90426088cefd5ff16e7347. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:10:18.487198 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-5f4d5be3-9a7b-4957-a3e6-0e6a6f02ea40 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Getting quotas for user 0f16217b495748478088d59006761959 and project e9b01b7e6d90426088cefd5ff16e7347. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:10:18.498777 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-5f4d5be3-9a7b-4957-a3e6-0e6a6f02ea40 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Going to run 1 instances... {{(pid=107453) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:10:18.501124 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-5f4d5be3-9a7b-4957-a3e6-0e6a6f02ea40 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eea29a7d-10c3-489a-adee-10be2e7a26bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:10:18.524699 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-bf8bc99c-9b76-47d6-9a18-2502ed57a346 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:18.532793 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-bf8bc99c-9b76-47d6-9a18-2502ed57a346 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.147085 Jul 30 16:10:18.533355 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 241/491] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:18 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:18.547353 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-5f4d5be3-9a7b-4957-a3e6-0e6a6f02ea40 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549578 Jul 30 16:10:18.547988 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 251/492] 10.222.0.37 () {60 vars in 1147 bytes} [Fri Jul 30 16:10:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 16:10:18.557515 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f0e65dca-d858-444d-85c1-d06dcb007e49 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:18.558134 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f0e65dca-d858-444d-85c1-d06dcb007e49 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:18.616028 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f0e65dca-d858-444d-85c1-d06dcb007e49 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:18.622511 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f0e65dca-d858-444d-85c1-d06dcb007e49 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1217 microversion: 2.1 time: 0.068652 Jul 30 16:10:18.623384 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 242/493] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:18 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:18.633790 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-43c6afce-7b5a-403a-bd42-bfff6b8e385a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:18.634527 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-43c6afce-7b5a-403a-bd42-bfff6b8e385a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:18.643387 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-43c6afce-7b5a-403a-bd42-bfff6b8e385a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:18.643914 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-43c6afce-7b5a-403a-bd42-bfff6b8e385a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:18.645052 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-43c6afce-7b5a-403a-bd42-bfff6b8e385a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:18.645571 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-43c6afce-7b5a-403a-bd42-bfff6b8e385a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:18.775664 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-43c6afce-7b5a-403a-bd42-bfff6b8e385a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:18.784208 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-43c6afce-7b5a-403a-bd42-bfff6b8e385a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:18.785790 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-43c6afce-7b5a-403a-bd42-bfff6b8e385a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:18.787054 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-43c6afce-7b5a-403a-bd42-bfff6b8e385a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.157166 Jul 30 16:10:18.787788 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 252/494] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:18 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:19.392460 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-fdfeaef2-1265-4d2d-9777-e4ad4d5daa2f tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:19.393011 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-fdfeaef2-1265-4d2d-9777-e4ad4d5daa2f tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:19.400070 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fdfeaef2-1265-4d2d-9777-e4ad4d5daa2f tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:19.400519 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fdfeaef2-1265-4d2d-9777-e4ad4d5daa2f tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:19.401293 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fdfeaef2-1265-4d2d-9777-e4ad4d5daa2f tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:19.401729 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fdfeaef2-1265-4d2d-9777-e4ad4d5daa2f tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:19.525086 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-fdfeaef2-1265-4d2d-9777-e4ad4d5daa2f tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:19.533177 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-fdfeaef2-1265-4d2d-9777-e4ad4d5daa2f tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1357 microversion: 2.1 time: 0.145350 Jul 30 16:10:19.533744 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 243/495] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:19 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:19.549396 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-09dabd10-f94a-4089-a60a-75f5363aff1a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:19.550003 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-09dabd10-f94a-4089-a60a-75f5363aff1a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:19.555697 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-09dabd10-f94a-4089-a60a-75f5363aff1a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:19.556139 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-09dabd10-f94a-4089-a60a-75f5363aff1a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:19.556895 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-09dabd10-f94a-4089-a60a-75f5363aff1a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:19.557317 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-09dabd10-f94a-4089-a60a-75f5363aff1a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:19.639378 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c846b028-16a4-4491-9766-961b1ca8a7e1 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:19.640330 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c846b028-16a4-4491-9766-961b1ca8a7e1 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:19.646146 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c846b028-16a4-4491-9766-961b1ca8a7e1 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:19.646527 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c846b028-16a4-4491-9766-961b1ca8a7e1 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:19.647311 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c846b028-16a4-4491-9766-961b1ca8a7e1 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:19.647745 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c846b028-16a4-4491-9766-961b1ca8a7e1 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:19.680290 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-09dabd10-f94a-4089-a60a-75f5363aff1a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:19.688802 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-09dabd10-f94a-4089-a60a-75f5363aff1a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.143014 Jul 30 16:10:19.689383 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 253/496] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:19 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:19.707950 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c846b028-16a4-4491-9766-961b1ca8a7e1 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:19.715077 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c846b028-16a4-4491-9766-961b1ca8a7e1 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1269 microversion: 2.1 time: 0.079959 Jul 30 16:10:19.715658 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 244/497] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:19 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1269 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:19.808149 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-60f58185-0f2f-4390-a90d-d590dab42c3e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:19.808759 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-60f58185-0f2f-4390-a90d-d590dab42c3e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:19.815063 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-60f58185-0f2f-4390-a90d-d590dab42c3e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:19.815554 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-60f58185-0f2f-4390-a90d-d590dab42c3e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:19.816323 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-60f58185-0f2f-4390-a90d-d590dab42c3e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:19.816760 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-60f58185-0f2f-4390-a90d-d590dab42c3e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:19.944438 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-60f58185-0f2f-4390-a90d-d590dab42c3e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:19.952709 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-60f58185-0f2f-4390-a90d-d590dab42c3e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:19.954508 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-60f58185-0f2f-4390-a90d-d590dab42c3e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:19.955376 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-60f58185-0f2f-4390-a90d-d590dab42c3e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.150904 Jul 30 16:10:19.959198 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 254/498] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:19 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:10:20.550191 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c0f827ad-deaa-483b-9970-db23ac3833c0 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:20.550821 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c0f827ad-deaa-483b-9970-db23ac3833c0 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:20.556652 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c0f827ad-deaa-483b-9970-db23ac3833c0 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:20.557093 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c0f827ad-deaa-483b-9970-db23ac3833c0 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:20.557858 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c0f827ad-deaa-483b-9970-db23ac3833c0 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:20.558286 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c0f827ad-deaa-483b-9970-db23ac3833c0 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:20.706200 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b18689fd-a7c2-454a-a4e0-262bb1d249ff tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:20.706747 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b18689fd-a7c2-454a-a4e0-262bb1d249ff tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:20.712552 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b18689fd-a7c2-454a-a4e0-262bb1d249ff tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:20.712999 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b18689fd-a7c2-454a-a4e0-262bb1d249ff tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:20.713771 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b18689fd-a7c2-454a-a4e0-262bb1d249ff tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:20.714204 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b18689fd-a7c2-454a-a4e0-262bb1d249ff tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:20.799016 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c0f827ad-deaa-483b-9970-db23ac3833c0 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:20.806413 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c0f827ad-deaa-483b-9970-db23ac3833c0 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1357 microversion: 2.1 time: 0.259941 Jul 30 16:10:20.807300 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 245/499] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:20 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1357 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:20.812050 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0bea511c-5f2f-4652-8dc1-380bf9afa810 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:20.812658 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0bea511c-5f2f-4652-8dc1-380bf9afa810 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:20.818380 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0bea511c-5f2f-4652-8dc1-380bf9afa810 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:20.818894 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0bea511c-5f2f-4652-8dc1-380bf9afa810 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:20.819712 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0bea511c-5f2f-4652-8dc1-380bf9afa810 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:20.820157 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0bea511c-5f2f-4652-8dc1-380bf9afa810 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:20.842272 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b18689fd-a7c2-454a-a4e0-262bb1d249ff tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:20.850149 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b18689fd-a7c2-454a-a4e0-262bb1d249ff tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.147712 Jul 30 16:10:20.850734 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 255/500] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:20 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:20.973810 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-93b30321-96a1-40a4-8275-aac7135e3582 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:20.974323 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-93b30321-96a1-40a4-8275-aac7135e3582 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:20.980327 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93b30321-96a1-40a4-8275-aac7135e3582 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:20.980770 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93b30321-96a1-40a4-8275-aac7135e3582 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:20.981527 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93b30321-96a1-40a4-8275-aac7135e3582 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:20.981969 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-93b30321-96a1-40a4-8275-aac7135e3582 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:21.016810 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0bea511c-5f2f-4652-8dc1-380bf9afa810 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:21.027538 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0bea511c-5f2f-4652-8dc1-380bf9afa810 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.218682 Jul 30 16:10:21.028586 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 246/501] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:20 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:21.126583 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-93b30321-96a1-40a4-8275-aac7135e3582 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:21.134516 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-93b30321-96a1-40a4-8275-aac7135e3582 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:21.136072 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-93b30321-96a1-40a4-8275-aac7135e3582 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:21.137249 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-93b30321-96a1-40a4-8275-aac7135e3582 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.167345 Jul 30 16:10:21.137794 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 256/502] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:20 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:21.270728 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-9276dc6e-6605-4d41-8f8c-b4f07f274431 req-bf594765-606c-444f-9c14-531de7e6453b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c5d7bd6-b662-4643-9c1d-a765d1bee1fa", "tag": "5cd5ad30-0cab-4585-9e7f-c3f967ec1d9f"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:10:21.279609 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:10:21.279609 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:10:21.303395 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-9276dc6e-6605-4d41-8f8c-b4f07f274431 req-bf594765-606c-444f-9c14-531de7e6453b service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:21.303845 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-9276dc6e-6605-4d41-8f8c-b4f07f274431 req-bf594765-606c-444f-9c14-531de7e6453b service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:21.317939 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-9276dc6e-6605-4d41-8f8c-b4f07f274431 req-bf594765-606c-444f-9c14-531de7e6453b service nova] Creating event network-changed:5cd5ad30-0cab-4585-9e7f-c3f967ec1d9f for instance 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa on hv-cinder-80304 Jul 30 16:10:21.322614 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-9276dc6e-6605-4d41-8f8c-b4f07f274431 req-bf594765-606c-444f-9c14-531de7e6453b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055489 Jul 30 16:10:21.323325 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 247/503] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:10:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:10:21.823736 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d67901b6-50c9-4ccd-9e29-8a615f8b385d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:21.824260 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d67901b6-50c9-4ccd-9e29-8a615f8b385d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:21.830753 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d67901b6-50c9-4ccd-9e29-8a615f8b385d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:21.831223 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d67901b6-50c9-4ccd-9e29-8a615f8b385d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:21.832001 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d67901b6-50c9-4ccd-9e29-8a615f8b385d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:21.832428 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d67901b6-50c9-4ccd-9e29-8a615f8b385d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:21.868312 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0a786161-6eb4-4405-b0ce-1ac17fe7ab7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:21.869605 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0a786161-6eb4-4405-b0ce-1ac17fe7ab7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:21.877377 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0a786161-6eb4-4405-b0ce-1ac17fe7ab7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:21.878427 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0a786161-6eb4-4405-b0ce-1ac17fe7ab7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:21.879606 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0a786161-6eb4-4405-b0ce-1ac17fe7ab7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:21.880411 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0a786161-6eb4-4405-b0ce-1ac17fe7ab7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:21.957322 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d67901b6-50c9-4ccd-9e29-8a615f8b385d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:21.964599 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d67901b6-50c9-4ccd-9e29-8a615f8b385d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1357 microversion: 2.1 time: 0.144660 Jul 30 16:10:21.965354 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 257/504] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:21 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:22.045575 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-26561af4-e6fd-4c00-884a-91ad20fa57bc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:22.046595 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-26561af4-e6fd-4c00-884a-91ad20fa57bc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:22.052831 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-26561af4-e6fd-4c00-884a-91ad20fa57bc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:22.053286 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-26561af4-e6fd-4c00-884a-91ad20fa57bc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:22.054078 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-26561af4-e6fd-4c00-884a-91ad20fa57bc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:22.054515 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-26561af4-e6fd-4c00-884a-91ad20fa57bc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:22.088998 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0a786161-6eb4-4405-b0ce-1ac17fe7ab7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:22.107390 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0a786161-6eb4-4405-b0ce-1ac17fe7ab7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.243664 Jul 30 16:10:22.108095 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 248/505] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:21 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:22.155905 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-63d045d2-5970-4c79-b1e2-a52e33908146 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:22.156691 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-63d045d2-5970-4c79-b1e2-a52e33908146 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:22.163886 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-63d045d2-5970-4c79-b1e2-a52e33908146 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:22.164559 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-63d045d2-5970-4c79-b1e2-a52e33908146 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:22.165455 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-63d045d2-5970-4c79-b1e2-a52e33908146 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:22.166072 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-63d045d2-5970-4c79-b1e2-a52e33908146 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:22.192683 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-26561af4-e6fd-4c00-884a-91ad20fa57bc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:22.200304 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-26561af4-e6fd-4c00-884a-91ad20fa57bc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.158671 Jul 30 16:10:22.208134 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 258/506] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:22 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:22.367470 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-63d045d2-5970-4c79-b1e2-a52e33908146 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:22.376594 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-63d045d2-5970-4c79-b1e2-a52e33908146 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:22.378107 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-63d045d2-5970-4c79-b1e2-a52e33908146 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:22.379287 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-63d045d2-5970-4c79-b1e2-a52e33908146 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.227036 Jul 30 16:10:22.380198 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 249/507] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:22 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:22.981784 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a083b47a-04bb-4cd6-b739-e14005851dcc tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:22.982686 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a083b47a-04bb-4cd6-b739-e14005851dcc tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:22.988530 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a083b47a-04bb-4cd6-b739-e14005851dcc tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:22.988978 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a083b47a-04bb-4cd6-b739-e14005851dcc tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:22.989748 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a083b47a-04bb-4cd6-b739-e14005851dcc tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:22.990182 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a083b47a-04bb-4cd6-b739-e14005851dcc tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:23.110966 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a083b47a-04bb-4cd6-b739-e14005851dcc tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:23.118079 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a083b47a-04bb-4cd6-b739-e14005851dcc tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1357 microversion: 2.1 time: 0.140062 Jul 30 16:10:23.118630 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 259/508] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:22 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1357 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:23.124127 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-40084d75-2e65-4530-b033-05f1e177c51e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:23.124742 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-40084d75-2e65-4530-b033-05f1e177c51e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:23.130482 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-40084d75-2e65-4530-b033-05f1e177c51e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:23.130932 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-40084d75-2e65-4530-b033-05f1e177c51e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:23.131742 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-40084d75-2e65-4530-b033-05f1e177c51e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:23.132181 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-40084d75-2e65-4530-b033-05f1e177c51e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:23.217594 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-14395d22-e112-46b5-bbf9-fd5fccbedb43 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:23.218223 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-14395d22-e112-46b5-bbf9-fd5fccbedb43 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:23.224258 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-14395d22-e112-46b5-bbf9-fd5fccbedb43 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:23.224707 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-14395d22-e112-46b5-bbf9-fd5fccbedb43 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:23.225486 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-14395d22-e112-46b5-bbf9-fd5fccbedb43 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:23.225923 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-14395d22-e112-46b5-bbf9-fd5fccbedb43 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:23.258882 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-40084d75-2e65-4530-b033-05f1e177c51e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:23.274442 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-40084d75-2e65-4530-b033-05f1e177c51e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.154071 Jul 30 16:10:23.275217 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 250/509] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:23 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:23.355320 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-14395d22-e112-46b5-bbf9-fd5fccbedb43 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:23.362961 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-14395d22-e112-46b5-bbf9-fd5fccbedb43 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.149607 Jul 30 16:10:23.363568 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 260/510] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:23 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:23.397961 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-bdc8541a-a449-4ba9-9e1e-67428c7c1e47 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:23.398753 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-bdc8541a-a449-4ba9-9e1e-67428c7c1e47 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:23.404811 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bdc8541a-a449-4ba9-9e1e-67428c7c1e47 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:23.405263 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bdc8541a-a449-4ba9-9e1e-67428c7c1e47 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:23.406070 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bdc8541a-a449-4ba9-9e1e-67428c7c1e47 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:23.406513 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bdc8541a-a449-4ba9-9e1e-67428c7c1e47 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:23.461464 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-779dca0d-c748-40a3-bd63-9fa7d5dd1c3b req-bcd0703e-fc8d-4140-9d4a-cca99601dbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb0becf-8d14-4c6b-8b46-82c09b52a5a6", "name": "network-vif-plugged", "status": "completed", "tag": "be55314f-44d9-47f6-87fd-5d73fbe32ff7"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:10:23.463096 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:10:23.463096 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:10:23.477312 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-779dca0d-c748-40a3-bd63-9fa7d5dd1c3b req-bcd0703e-fc8d-4140-9d4a-cca99601dbe2 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:23.477839 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-779dca0d-c748-40a3-bd63-9fa7d5dd1c3b req-bcd0703e-fc8d-4140-9d4a-cca99601dbe2 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:23.489472 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-779dca0d-c748-40a3-bd63-9fa7d5dd1c3b req-bcd0703e-fc8d-4140-9d4a-cca99601dbe2 service nova] Creating event network-vif-plugged:be55314f-44d9-47f6-87fd-5d73fbe32ff7 for instance 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 on hv-cinder-80304 Jul 30 16:10:23.494621 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-779dca0d-c748-40a3-bd63-9fa7d5dd1c3b req-bcd0703e-fc8d-4140-9d4a-cca99601dbe2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042082 Jul 30 16:10:23.495531 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 261/511] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:10:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:10:23.545193 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-bdc8541a-a449-4ba9-9e1e-67428c7c1e47 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:23.552976 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-bdc8541a-a449-4ba9-9e1e-67428c7c1e47 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:23.554488 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-bdc8541a-a449-4ba9-9e1e-67428c7c1e47 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:23.555667 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-bdc8541a-a449-4ba9-9e1e-67428c7c1e47 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.161897 Jul 30 16:10:23.556273 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 251/512] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:23 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:10:24.135217 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4904d549-4c12-4f32-8f12-1fabc2ca72c5 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:24.135848 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4904d549-4c12-4f32-8f12-1fabc2ca72c5 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:24.142285 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4904d549-4c12-4f32-8f12-1fabc2ca72c5 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:24.142739 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4904d549-4c12-4f32-8f12-1fabc2ca72c5 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:24.143543 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4904d549-4c12-4f32-8f12-1fabc2ca72c5 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:24.143979 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4904d549-4c12-4f32-8f12-1fabc2ca72c5 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:24.261218 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4904d549-4c12-4f32-8f12-1fabc2ca72c5 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:24.268938 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4904d549-4c12-4f32-8f12-1fabc2ca72c5 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1357 microversion: 2.1 time: 0.137844 Jul 30 16:10:24.269499 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 262/513] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:24 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1357 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:24.291758 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c2048c40-a2bc-4731-b11b-5b68f8b3c12f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:24.292374 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c2048c40-a2bc-4731-b11b-5b68f8b3c12f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:24.299147 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c2048c40-a2bc-4731-b11b-5b68f8b3c12f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:24.299614 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c2048c40-a2bc-4731-b11b-5b68f8b3c12f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:24.300397 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c2048c40-a2bc-4731-b11b-5b68f8b3c12f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:24.300844 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c2048c40-a2bc-4731-b11b-5b68f8b3c12f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:24.379419 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b61d6579-6c01-4683-b3c2-696a388cb256 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:24.380082 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b61d6579-6c01-4683-b3c2-696a388cb256 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:24.385968 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b61d6579-6c01-4683-b3c2-696a388cb256 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:24.386369 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b61d6579-6c01-4683-b3c2-696a388cb256 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:24.387155 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b61d6579-6c01-4683-b3c2-696a388cb256 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:24.387618 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b61d6579-6c01-4683-b3c2-696a388cb256 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:24.521800 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b61d6579-6c01-4683-b3c2-696a388cb256 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:24.530319 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b61d6579-6c01-4683-b3c2-696a388cb256 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.154505 Jul 30 16:10:24.531261 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 263/514] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:24 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:24.574319 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-6d5f1f90-5614-439f-b393-35d3256ede49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:24.574970 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-6d5f1f90-5614-439f-b393-35d3256ede49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:24.581705 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6d5f1f90-5614-439f-b393-35d3256ede49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:24.582146 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6d5f1f90-5614-439f-b393-35d3256ede49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:24.582916 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6d5f1f90-5614-439f-b393-35d3256ede49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:24.583370 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6d5f1f90-5614-439f-b393-35d3256ede49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:24.645300 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c2048c40-a2bc-4731-b11b-5b68f8b3c12f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:24.653621 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c2048c40-a2bc-4731-b11b-5b68f8b3c12f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.365412 Jul 30 16:10:24.655092 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 252/515] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:24 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:24.720327 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6d5f1f90-5614-439f-b393-35d3256ede49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:24.728034 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6d5f1f90-5614-439f-b393-35d3256ede49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:24.729544 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6d5f1f90-5614-439f-b393-35d3256ede49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:24.730680 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-6d5f1f90-5614-439f-b393-35d3256ede49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.160162 Jul 30 16:10:24.731249 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 264/516] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:24 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:25.285995 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-5b711312-226c-4dba-876d-b822dbd78611 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:25.286600 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-5b711312-226c-4dba-876d-b822dbd78611 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:25.292513 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5b711312-226c-4dba-876d-b822dbd78611 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:25.293060 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5b711312-226c-4dba-876d-b822dbd78611 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:25.293718 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5b711312-226c-4dba-876d-b822dbd78611 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:25.294151 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5b711312-226c-4dba-876d-b822dbd78611 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:25.436531 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-5b711312-226c-4dba-876d-b822dbd78611 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:25.444537 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-5b711312-226c-4dba-876d-b822dbd78611 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1357 microversion: 2.1 time: 0.162158 Jul 30 16:10:25.455753 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 253/517] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:25 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:25.548045 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-68ecbd8a-9d01-467d-8365-6ebcda0c1270 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:25.548662 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-68ecbd8a-9d01-467d-8365-6ebcda0c1270 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:25.569919 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-68ecbd8a-9d01-467d-8365-6ebcda0c1270 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:25.570385 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-68ecbd8a-9d01-467d-8365-6ebcda0c1270 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:25.571282 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-68ecbd8a-9d01-467d-8365-6ebcda0c1270 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:25.571725 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-68ecbd8a-9d01-467d-8365-6ebcda0c1270 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:25.671816 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e28712c5-e76d-4e78-9dbd-f96da5c7dc89 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:25.672435 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e28712c5-e76d-4e78-9dbd-f96da5c7dc89 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:25.678352 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e28712c5-e76d-4e78-9dbd-f96da5c7dc89 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:25.678829 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e28712c5-e76d-4e78-9dbd-f96da5c7dc89 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:25.679643 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e28712c5-e76d-4e78-9dbd-f96da5c7dc89 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:25.680082 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e28712c5-e76d-4e78-9dbd-f96da5c7dc89 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:25.704856 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-68ecbd8a-9d01-467d-8365-6ebcda0c1270 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:25.712071 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-68ecbd8a-9d01-467d-8365-6ebcda0c1270 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.168850 Jul 30 16:10:25.712758 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 265/518] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:25 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:25.749399 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-60dcbf0d-3f2b-4194-a54c-ab8cfc955e82 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:25.750007 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-60dcbf0d-3f2b-4194-a54c-ab8cfc955e82 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:25.756000 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-60dcbf0d-3f2b-4194-a54c-ab8cfc955e82 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:25.756457 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-60dcbf0d-3f2b-4194-a54c-ab8cfc955e82 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:25.757405 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-60dcbf0d-3f2b-4194-a54c-ab8cfc955e82 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:25.757849 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-60dcbf0d-3f2b-4194-a54c-ab8cfc955e82 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:25.837130 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e28712c5-e76d-4e78-9dbd-f96da5c7dc89 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:25.845810 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e28712c5-e76d-4e78-9dbd-f96da5c7dc89 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.178013 Jul 30 16:10:25.846376 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 254/519] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:25 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:25.898260 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-60dcbf0d-3f2b-4194-a54c-ab8cfc955e82 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:25.906321 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-60dcbf0d-3f2b-4194-a54c-ab8cfc955e82 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:25.907919 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-60dcbf0d-3f2b-4194-a54c-ab8cfc955e82 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:25.909057 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-60dcbf0d-3f2b-4194-a54c-ab8cfc955e82 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.164219 Jul 30 16:10:25.909844 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 266/520] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:25 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:26.462371 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0a3da697-a828-4a2c-9e31-9fc1a2e4aaac tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:26.463069 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0a3da697-a828-4a2c-9e31-9fc1a2e4aaac tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:26.469831 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0a3da697-a828-4a2c-9e31-9fc1a2e4aaac tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:26.470285 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0a3da697-a828-4a2c-9e31-9fc1a2e4aaac tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:26.471084 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0a3da697-a828-4a2c-9e31-9fc1a2e4aaac tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:26.471565 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0a3da697-a828-4a2c-9e31-9fc1a2e4aaac tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:26.595770 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0a3da697-a828-4a2c-9e31-9fc1a2e4aaac tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:26.602975 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0a3da697-a828-4a2c-9e31-9fc1a2e4aaac tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1548 microversion: 2.1 time: 0.144427 Jul 30 16:10:26.603560 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 255/521] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:26 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1548 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:26.619230 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4586ae4e-8eee-4ccb-b313-bd44c1cb3645 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:26.619842 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4586ae4e-8eee-4ccb-b313-bd44c1cb3645 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:26.626121 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4586ae4e-8eee-4ccb-b313-bd44c1cb3645 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:26.626567 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4586ae4e-8eee-4ccb-b313-bd44c1cb3645 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:26.627359 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4586ae4e-8eee-4ccb-b313-bd44c1cb3645 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:26.627799 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4586ae4e-8eee-4ccb-b313-bd44c1cb3645 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:26.729237 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-28f91619-c8f6-4f5b-9e79-2bd0196d5efc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:26.731541 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-28f91619-c8f6-4f5b-9e79-2bd0196d5efc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:26.736521 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-28f91619-c8f6-4f5b-9e79-2bd0196d5efc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:26.736975 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-28f91619-c8f6-4f5b-9e79-2bd0196d5efc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:26.737789 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-28f91619-c8f6-4f5b-9e79-2bd0196d5efc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:26.738233 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-28f91619-c8f6-4f5b-9e79-2bd0196d5efc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:26.751707 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4586ae4e-8eee-4ccb-b313-bd44c1cb3645 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:26.758930 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4586ae4e-8eee-4ccb-b313-bd44c1cb3645 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1548 microversion: 2.1 time: 0.143335 Jul 30 16:10:26.759519 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 267/522] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:26 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1548 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:26.775298 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-70f8b9bc-8378-4ed7-85a0-61114119cabe tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:26.778677 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:10:26.778677 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:10:26.779795 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-70f8b9bc-8378-4ed7-85a0-61114119cabe tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:26.780685 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-70f8b9bc-8378-4ed7-85a0-61114119cabe tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Searching by: {'deleted': False, 'project_id': 'f36597e2839440af8e51082842f1d063'} {{(pid=107453) get_all /opt/stack/nova/nova/compute/api.py:2833}} Jul 30 16:10:26.787446 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-70f8b9bc-8378-4ed7-85a0-61114119cabe tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:26.787892 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-70f8b9bc-8378-4ed7-85a0-61114119cabe tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:26.788695 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-70f8b9bc-8378-4ed7-85a0-61114119cabe tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:26.789136 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-70f8b9bc-8378-4ed7-85a0-61114119cabe tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:26.860488 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-28f91619-c8f6-4f5b-9e79-2bd0196d5efc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:26.867741 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-28f91619-c8f6-4f5b-9e79-2bd0196d5efc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.142202 Jul 30 16:10:26.868309 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 256/523] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:26 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:26.872528 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0d6869b8-e11d-4e3f-9d31-8ed7f1df71b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:26.873777 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0d6869b8-e11d-4e3f-9d31-8ed7f1df71b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:26.879244 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0d6869b8-e11d-4e3f-9d31-8ed7f1df71b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:26.879703 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0d6869b8-e11d-4e3f-9d31-8ed7f1df71b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:26.880480 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0d6869b8-e11d-4e3f-9d31-8ed7f1df71b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:26.880919 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0d6869b8-e11d-4e3f-9d31-8ed7f1df71b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:26.881280 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.multi_cell_list [None req-70f8b9bc-8378-4ed7-85a0-61114119cabe tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=107453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Jul 30 16:10:26.976103 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-70f8b9bc-8378-4ed7-85a0-61114119cabe tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204258 Jul 30 16:10:26.976683 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 268/524] 10.222.0.37 () {58 vars in 1125 bytes} [Fri Jul 30 16:10:26 2021] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:10:26.981928 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e1cbe8d7-7e3d-419b-9b26-8e2e2104a8e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:26.981928 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e1cbe8d7-7e3d-419b-9b26-8e2e2104a8e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:26.987593 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e1cbe8d7-7e3d-419b-9b26-8e2e2104a8e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:26.988040 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e1cbe8d7-7e3d-419b-9b26-8e2e2104a8e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:26.988814 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e1cbe8d7-7e3d-419b-9b26-8e2e2104a8e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:26.989251 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e1cbe8d7-7e3d-419b-9b26-8e2e2104a8e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:27.001153 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0d6869b8-e11d-4e3f-9d31-8ed7f1df71b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:27.009274 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0d6869b8-e11d-4e3f-9d31-8ed7f1df71b4 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.139956 Jul 30 16:10:27.009862 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 257/525] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:26 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:27.015491 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b64711dc-0e04-4869-970d-655c419da7e4 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:27.015632 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b64711dc-0e04-4869-970d-655c419da7e4 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:27.021451 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b64711dc-0e04-4869-970d-655c419da7e4 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:27.021905 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b64711dc-0e04-4869-970d-655c419da7e4 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:27.022684 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b64711dc-0e04-4869-970d-655c419da7e4 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:27.023146 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b64711dc-0e04-4869-970d-655c419da7e4 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:27.121491 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e1cbe8d7-7e3d-419b-9b26-8e2e2104a8e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:27.130352 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e1cbe8d7-7e3d-419b-9b26-8e2e2104a8e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:27.131954 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e1cbe8d7-7e3d-419b-9b26-8e2e2104a8e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:27.133129 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e1cbe8d7-7e3d-419b-9b26-8e2e2104a8e4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.155514 Jul 30 16:10:27.133716 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 269/526] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:26 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:10:27.153503 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b64711dc-0e04-4869-970d-655c419da7e4 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:27.161052 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b64711dc-0e04-4869-970d-655c419da7e4 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1548 microversion: 2.1 time: 0.150238 Jul 30 16:10:27.161604 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 258/527] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:27 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:27.884830 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a4fe0bbf-181a-4a34-8b8c-036ea404d610 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:27.885440 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a4fe0bbf-181a-4a34-8b8c-036ea404d610 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:27.891552 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a4fe0bbf-181a-4a34-8b8c-036ea404d610 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:27.891992 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a4fe0bbf-181a-4a34-8b8c-036ea404d610 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:27.892751 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a4fe0bbf-181a-4a34-8b8c-036ea404d610 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:27.893176 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a4fe0bbf-181a-4a34-8b8c-036ea404d610 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:28.018051 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a4fe0bbf-181a-4a34-8b8c-036ea404d610 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:28.025905 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a4fe0bbf-181a-4a34-8b8c-036ea404d610 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.144461 Jul 30 16:10:28.026369 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-bc12cea9-481f-4e36-951e-9a2e0afddb2b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:28.026964 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 270/528] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:27 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:28.027070 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-bc12cea9-481f-4e36-951e-9a2e0afddb2b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:28.033306 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bc12cea9-481f-4e36-951e-9a2e0afddb2b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:28.033758 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bc12cea9-481f-4e36-951e-9a2e0afddb2b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:28.034542 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bc12cea9-481f-4e36-951e-9a2e0afddb2b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:28.034976 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bc12cea9-481f-4e36-951e-9a2e0afddb2b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:28.150784 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-bc12cea9-481f-4e36-951e-9a2e0afddb2b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:28.152557 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-155b35e8-663f-4f30-a6aa-098a3814bba0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:28.153228 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-155b35e8-663f-4f30-a6aa-098a3814bba0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:28.159069 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-bc12cea9-481f-4e36-951e-9a2e0afddb2b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.136295 Jul 30 16:10:28.159534 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-155b35e8-663f-4f30-a6aa-098a3814bba0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:28.159980 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-155b35e8-663f-4f30-a6aa-098a3814bba0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:28.160218 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 259/529] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:28 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:28.160812 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-155b35e8-663f-4f30-a6aa-098a3814bba0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:28.161245 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-155b35e8-663f-4f30-a6aa-098a3814bba0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:28.278772 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-155b35e8-663f-4f30-a6aa-098a3814bba0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:28.287070 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-155b35e8-663f-4f30-a6aa-098a3814bba0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:28.288596 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-155b35e8-663f-4f30-a6aa-098a3814bba0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:28.289719 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-155b35e8-663f-4f30-a6aa-098a3814bba0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.141059 Jul 30 16:10:28.290269 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 271/530] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:28 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:29.042913 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b645cb57-249b-41cd-93fd-ab58cb1dfc96 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:29.043553 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b645cb57-249b-41cd-93fd-ab58cb1dfc96 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:29.049493 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b645cb57-249b-41cd-93fd-ab58cb1dfc96 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:29.049949 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b645cb57-249b-41cd-93fd-ab58cb1dfc96 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:29.050719 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b645cb57-249b-41cd-93fd-ab58cb1dfc96 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:29.051181 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b645cb57-249b-41cd-93fd-ab58cb1dfc96 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:29.172505 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b645cb57-249b-41cd-93fd-ab58cb1dfc96 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:29.175585 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-56ea5263-c3b6-4c59-be20-c6c3069de328 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:29.176197 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-56ea5263-c3b6-4c59-be20-c6c3069de328 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:29.179739 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b645cb57-249b-41cd-93fd-ab58cb1dfc96 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.140482 Jul 30 16:10:29.180310 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 260/531] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:29 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:29.181927 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56ea5263-c3b6-4c59-be20-c6c3069de328 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:29.182376 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56ea5263-c3b6-4c59-be20-c6c3069de328 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:29.183169 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56ea5263-c3b6-4c59-be20-c6c3069de328 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:29.183608 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56ea5263-c3b6-4c59-be20-c6c3069de328 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:29.300079 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-56ea5263-c3b6-4c59-be20-c6c3069de328 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:29.307776 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-56ea5263-c3b6-4c59-be20-c6c3069de328 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.135832 Jul 30 16:10:29.307963 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d3bf6434-406b-4319-8374-e43bf3ce4ea1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:29.308337 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 272/532] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:29 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:29.308570 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d3bf6434-406b-4319-8374-e43bf3ce4ea1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:29.315078 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d3bf6434-406b-4319-8374-e43bf3ce4ea1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:29.315555 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d3bf6434-406b-4319-8374-e43bf3ce4ea1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:29.316318 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d3bf6434-406b-4319-8374-e43bf3ce4ea1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:29.316746 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d3bf6434-406b-4319-8374-e43bf3ce4ea1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:29.445850 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d3bf6434-406b-4319-8374-e43bf3ce4ea1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:29.454328 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d3bf6434-406b-4319-8374-e43bf3ce4ea1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:29.455910 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d3bf6434-406b-4319-8374-e43bf3ce4ea1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:29.457051 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d3bf6434-406b-4319-8374-e43bf3ce4ea1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.152719 Jul 30 16:10:29.457601 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 261/533] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:29 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:30.196392 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0e6c4d8d-50f5-4282-9d13-4bd5bd2ec43e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:30.196931 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0e6c4d8d-50f5-4282-9d13-4bd5bd2ec43e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:30.203225 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0e6c4d8d-50f5-4282-9d13-4bd5bd2ec43e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:30.203675 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0e6c4d8d-50f5-4282-9d13-4bd5bd2ec43e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:30.204439 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0e6c4d8d-50f5-4282-9d13-4bd5bd2ec43e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:30.204875 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0e6c4d8d-50f5-4282-9d13-4bd5bd2ec43e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:30.324382 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-05afde40-7fbb-4d2e-802d-4cc2df96ae11 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:30.324992 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-05afde40-7fbb-4d2e-802d-4cc2df96ae11 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:30.328756 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0e6c4d8d-50f5-4282-9d13-4bd5bd2ec43e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:30.331306 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-05afde40-7fbb-4d2e-802d-4cc2df96ae11 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:30.331765 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-05afde40-7fbb-4d2e-802d-4cc2df96ae11 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:30.332552 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-05afde40-7fbb-4d2e-802d-4cc2df96ae11 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:30.332991 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-05afde40-7fbb-4d2e-802d-4cc2df96ae11 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:30.336025 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0e6c4d8d-50f5-4282-9d13-4bd5bd2ec43e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.143599 Jul 30 16:10:30.336980 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 273/534] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:30 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:30.452431 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-05afde40-7fbb-4d2e-802d-4cc2df96ae11 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:30.459329 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-05afde40-7fbb-4d2e-802d-4cc2df96ae11 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.138562 Jul 30 16:10:30.459902 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 262/535] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:30 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:30.474964 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f5077abc-f538-48b7-93c2-0ac9ca24044a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:30.475600 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f5077abc-f538-48b7-93c2-0ac9ca24044a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:30.481349 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f5077abc-f538-48b7-93c2-0ac9ca24044a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:30.481799 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f5077abc-f538-48b7-93c2-0ac9ca24044a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:30.482898 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f5077abc-f538-48b7-93c2-0ac9ca24044a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:30.483378 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f5077abc-f538-48b7-93c2-0ac9ca24044a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:30.602214 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f5077abc-f538-48b7-93c2-0ac9ca24044a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:30.610176 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f5077abc-f538-48b7-93c2-0ac9ca24044a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:30.611705 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f5077abc-f538-48b7-93c2-0ac9ca24044a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:30.612857 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f5077abc-f538-48b7-93c2-0ac9ca24044a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.141563 Jul 30 16:10:30.613394 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 274/536] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:30 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:31.353043 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-04ced45e-976b-4395-a59b-e0e6c686d0cc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:31.353649 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-04ced45e-976b-4395-a59b-e0e6c686d0cc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:31.359577 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-04ced45e-976b-4395-a59b-e0e6c686d0cc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:31.360021 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-04ced45e-976b-4395-a59b-e0e6c686d0cc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:31.360776 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-04ced45e-976b-4395-a59b-e0e6c686d0cc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:31.361199 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-04ced45e-976b-4395-a59b-e0e6c686d0cc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:31.476677 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-6e0da4dc-a734-447e-9360-0d496347aac3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:31.477267 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-6e0da4dc-a734-447e-9360-0d496347aac3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:31.483258 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6e0da4dc-a734-447e-9360-0d496347aac3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:31.483704 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6e0da4dc-a734-447e-9360-0d496347aac3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:31.484480 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6e0da4dc-a734-447e-9360-0d496347aac3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:31.484785 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-04ced45e-976b-4395-a59b-e0e6c686d0cc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:31.484903 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6e0da4dc-a734-447e-9360-0d496347aac3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:31.492035 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-04ced45e-976b-4395-a59b-e0e6c686d0cc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.142734 Jul 30 16:10:31.492596 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 263/537] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:31 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:31.602669 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6e0da4dc-a734-447e-9360-0d496347aac3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:31.610342 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-6e0da4dc-a734-447e-9360-0d496347aac3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.137287 Jul 30 16:10:31.610978 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 275/538] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:31 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:31.631215 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9470230b-1cde-4fac-b1a6-f5d4f5c5d09d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:31.631864 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9470230b-1cde-4fac-b1a6-f5d4f5c5d09d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:31.637600 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9470230b-1cde-4fac-b1a6-f5d4f5c5d09d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:31.637997 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9470230b-1cde-4fac-b1a6-f5d4f5c5d09d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:31.639427 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9470230b-1cde-4fac-b1a6-f5d4f5c5d09d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:31.639875 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9470230b-1cde-4fac-b1a6-f5d4f5c5d09d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:31.771929 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9470230b-1cde-4fac-b1a6-f5d4f5c5d09d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:31.779927 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9470230b-1cde-4fac-b1a6-f5d4f5c5d09d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:31.781567 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9470230b-1cde-4fac-b1a6-f5d4f5c5d09d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:31.782700 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9470230b-1cde-4fac-b1a6-f5d4f5c5d09d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.155349 Jul 30 16:10:31.783549 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 264/539] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:31 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:10:31.821504 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9024e15b-69d0-4139-b7bd-8b17c90eff34 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d30997f7-5508-4e25-8f69-a1919e2148d5"}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:10:31.822560 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9024e15b-69d0-4139-b7bd-8b17c90eff34 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:31.829344 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9024e15b-69d0-4139-b7bd-8b17c90eff34 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:31.829799 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9024e15b-69d0-4139-b7bd-8b17c90eff34 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:31.830565 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9024e15b-69d0-4139-b7bd-8b17c90eff34 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:31.831005 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9024e15b-69d0-4139-b7bd-8b17c90eff34 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:32.100575 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9024e15b-69d0-4139-b7bd-8b17c90eff34 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "POST /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282619 Jul 30 16:10:32.101746 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 276/540] 10.222.0.37 () {60 vars in 1323 bytes} [Fri Jul 30 16:10:31 2021] POST /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:10:32.508765 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-329de579-9c9c-4ed7-9678-bf6e1d95bc1b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:32.509407 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-329de579-9c9c-4ed7-9678-bf6e1d95bc1b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:32.516316 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-329de579-9c9c-4ed7-9678-bf6e1d95bc1b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:32.516767 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-329de579-9c9c-4ed7-9678-bf6e1d95bc1b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:32.517536 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-329de579-9c9c-4ed7-9678-bf6e1d95bc1b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:32.517976 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-329de579-9c9c-4ed7-9678-bf6e1d95bc1b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:32.628114 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d7d71e41-a983-49c6-a835-623e1ab95076 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:32.628807 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d7d71e41-a983-49c6-a835-623e1ab95076 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:32.633876 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-329de579-9c9c-4ed7-9678-bf6e1d95bc1b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:32.635700 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d7d71e41-a983-49c6-a835-623e1ab95076 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:32.636148 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d7d71e41-a983-49c6-a835-623e1ab95076 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:32.636950 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d7d71e41-a983-49c6-a835-623e1ab95076 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:32.637373 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d7d71e41-a983-49c6-a835-623e1ab95076 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:32.642038 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-329de579-9c9c-4ed7-9678-bf6e1d95bc1b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.136930 Jul 30 16:10:32.642610 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 265/541] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:32 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:32.801506 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6b09f16e-390a-4338-a2b6-faa9602e1911 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:32.802125 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6b09f16e-390a-4338-a2b6-faa9602e1911 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:32.808711 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6b09f16e-390a-4338-a2b6-faa9602e1911 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:32.809136 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6b09f16e-390a-4338-a2b6-faa9602e1911 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:32.809937 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6b09f16e-390a-4338-a2b6-faa9602e1911 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:32.810947 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6b09f16e-390a-4338-a2b6-faa9602e1911 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:32.944311 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6b09f16e-390a-4338-a2b6-faa9602e1911 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:32.953416 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6b09f16e-390a-4338-a2b6-faa9602e1911 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:32.956422 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6b09f16e-390a-4338-a2b6-faa9602e1911 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:32.958280 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6b09f16e-390a-4338-a2b6-faa9602e1911 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.160512 Jul 30 16:10:32.958841 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 266/542] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:32 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:32.978759 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d7d71e41-a983-49c6-a835-623e1ab95076 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:32.986710 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d7d71e41-a983-49c6-a835-623e1ab95076 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.362665 Jul 30 16:10:32.987296 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 277/543] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:32 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:33.657381 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8f5773c6-b265-4bae-9efa-57c21393371f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:33.657996 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8f5773c6-b265-4bae-9efa-57c21393371f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:33.663952 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f5773c6-b265-4bae-9efa-57c21393371f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:33.664404 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f5773c6-b265-4bae-9efa-57c21393371f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:33.665174 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f5773c6-b265-4bae-9efa-57c21393371f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:33.665668 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f5773c6-b265-4bae-9efa-57c21393371f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:33.792989 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8f5773c6-b265-4bae-9efa-57c21393371f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:33.804228 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8f5773c6-b265-4bae-9efa-57c21393371f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.150356 Jul 30 16:10:33.805059 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 267/544] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:33 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:33.977098 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-6a89b90a-bff7-410d-860f-3bc471ad1a77 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:33.977728 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-6a89b90a-bff7-410d-860f-3bc471ad1a77 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:33.984564 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6a89b90a-bff7-410d-860f-3bc471ad1a77 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:33.985010 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6a89b90a-bff7-410d-860f-3bc471ad1a77 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:33.985802 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6a89b90a-bff7-410d-860f-3bc471ad1a77 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:33.986233 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6a89b90a-bff7-410d-860f-3bc471ad1a77 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:34.002484 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-85b24e12-8677-43bf-a4de-e11969317c36 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:34.003097 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-85b24e12-8677-43bf-a4de-e11969317c36 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:34.008861 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-85b24e12-8677-43bf-a4de-e11969317c36 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:34.009318 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-85b24e12-8677-43bf-a4de-e11969317c36 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:34.010084 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-85b24e12-8677-43bf-a4de-e11969317c36 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:34.010527 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-85b24e12-8677-43bf-a4de-e11969317c36 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:34.112421 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6a89b90a-bff7-410d-860f-3bc471ad1a77 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:34.120402 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6a89b90a-bff7-410d-860f-3bc471ad1a77 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:34.121920 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6a89b90a-bff7-410d-860f-3bc471ad1a77 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:34.123149 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-6a89b90a-bff7-410d-860f-3bc471ad1a77 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.149763 Jul 30 16:10:34.123715 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 278/545] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:33 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:10:34.133283 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-85b24e12-8677-43bf-a4de-e11969317c36 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:34.141193 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-85b24e12-8677-43bf-a4de-e11969317c36 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.142371 Jul 30 16:10:34.141742 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 268/546] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:33 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:34.826700 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-68047799-5c56-4d2a-9c8c-49e5cde1869b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:34.827383 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-68047799-5c56-4d2a-9c8c-49e5cde1869b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:34.833312 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-68047799-5c56-4d2a-9c8c-49e5cde1869b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:34.833756 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-68047799-5c56-4d2a-9c8c-49e5cde1869b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:34.834517 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-68047799-5c56-4d2a-9c8c-49e5cde1869b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:34.834946 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-68047799-5c56-4d2a-9c8c-49e5cde1869b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:34.915789 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-f2158aa1-8824-4e94-998e-ca60c0fab590 req-0d492e9c-420b-4cd9-b667-b7c20cb1f8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5d7bd6-b662-4643-9c1d-a765d1bee1fa", "name": "network-vif-plugged", "status": "completed", "tag": "5cd5ad30-0cab-4585-9e7f-c3f967ec1d9f"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:10:34.922175 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:10:34.922175 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:10:34.931497 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-f2158aa1-8824-4e94-998e-ca60c0fab590 req-0d492e9c-420b-4cd9-b667-b7c20cb1f8b6 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:34.931978 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-f2158aa1-8824-4e94-998e-ca60c0fab590 req-0d492e9c-420b-4cd9-b667-b7c20cb1f8b6 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:34.946083 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-f2158aa1-8824-4e94-998e-ca60c0fab590 req-0d492e9c-420b-4cd9-b667-b7c20cb1f8b6 service nova] Creating event network-vif-plugged:5cd5ad30-0cab-4585-9e7f-c3f967ec1d9f for instance 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa on hv-cinder-80304 Jul 30 16:10:34.951407 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-f2158aa1-8824-4e94-998e-ca60c0fab590 req-0d492e9c-420b-4cd9-b667-b7c20cb1f8b6 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039106 Jul 30 16:10:34.952383 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 269/547] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:10:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:10:34.964548 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-68047799-5c56-4d2a-9c8c-49e5cde1869b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:34.971938 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-68047799-5c56-4d2a-9c8c-49e5cde1869b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.149567 Jul 30 16:10:34.972495 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 279/548] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:34 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:35.142506 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-575f2746-ea60-4640-8b71-4a5114d33dc0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:35.143198 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-575f2746-ea60-4640-8b71-4a5114d33dc0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:35.149280 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-575f2746-ea60-4640-8b71-4a5114d33dc0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:35.149722 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-575f2746-ea60-4640-8b71-4a5114d33dc0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:35.150512 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-575f2746-ea60-4640-8b71-4a5114d33dc0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:35.150941 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-575f2746-ea60-4640-8b71-4a5114d33dc0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:35.157674 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-98d74d53-e570-406e-8c2d-c7110f3a6377 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:35.158447 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-98d74d53-e570-406e-8c2d-c7110f3a6377 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:35.164257 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-98d74d53-e570-406e-8c2d-c7110f3a6377 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:35.164714 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-98d74d53-e570-406e-8c2d-c7110f3a6377 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:35.165490 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-98d74d53-e570-406e-8c2d-c7110f3a6377 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:35.165925 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-98d74d53-e570-406e-8c2d-c7110f3a6377 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:35.273791 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-575f2746-ea60-4640-8b71-4a5114d33dc0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:35.282227 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-575f2746-ea60-4640-8b71-4a5114d33dc0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:35.283772 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-575f2746-ea60-4640-8b71-4a5114d33dc0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:35.284989 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-575f2746-ea60-4640-8b71-4a5114d33dc0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.146930 Jul 30 16:10:35.285620 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 270/549] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:35 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:10:35.291646 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-98d74d53-e570-406e-8c2d-c7110f3a6377 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:35.301656 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-98d74d53-e570-406e-8c2d-c7110f3a6377 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.147873 Jul 30 16:10:35.302306 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 280/550] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:35 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:35.988576 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6c880b62-80c8-4aba-a3d5-a2703ff2008e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:35.989228 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6c880b62-80c8-4aba-a3d5-a2703ff2008e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:35.995311 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6c880b62-80c8-4aba-a3d5-a2703ff2008e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:35.995765 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6c880b62-80c8-4aba-a3d5-a2703ff2008e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:35.996544 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6c880b62-80c8-4aba-a3d5-a2703ff2008e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:35.996981 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6c880b62-80c8-4aba-a3d5-a2703ff2008e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:36.127838 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6c880b62-80c8-4aba-a3d5-a2703ff2008e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:36.135123 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6c880b62-80c8-4aba-a3d5-a2703ff2008e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.150134 Jul 30 16:10:36.135716 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 271/551] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:35 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:36.304095 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-404dff83-4d14-4ea3-aa99-faed58a29299 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:36.305481 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-404dff83-4d14-4ea3-aa99-faed58a29299 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:36.323577 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-404dff83-4d14-4ea3-aa99-faed58a29299 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:36.324037 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-404dff83-4d14-4ea3-aa99-faed58a29299 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:36.325048 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-404dff83-4d14-4ea3-aa99-faed58a29299 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:36.325331 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-404dff83-4d14-4ea3-aa99-faed58a29299 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:36.326205 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0cdb6326-e9a7-4126-b8f2-9b0e8147fe2e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:36.327433 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0cdb6326-e9a7-4126-b8f2-9b0e8147fe2e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:36.344183 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0cdb6326-e9a7-4126-b8f2-9b0e8147fe2e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:36.344641 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0cdb6326-e9a7-4126-b8f2-9b0e8147fe2e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:36.345436 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0cdb6326-e9a7-4126-b8f2-9b0e8147fe2e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:36.345875 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0cdb6326-e9a7-4126-b8f2-9b0e8147fe2e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:36.470925 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0cdb6326-e9a7-4126-b8f2-9b0e8147fe2e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:36.471592 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-404dff83-4d14-4ea3-aa99-faed58a29299 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:36.478786 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0cdb6326-e9a7-4126-b8f2-9b0e8147fe2e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.156503 Jul 30 16:10:36.479383 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 272/552] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:36 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:36.479876 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-404dff83-4d14-4ea3-aa99-faed58a29299 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:36.481485 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-404dff83-4d14-4ea3-aa99-faed58a29299 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:36.485562 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-404dff83-4d14-4ea3-aa99-faed58a29299 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.183748 Jul 30 16:10:36.485562 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 281/553] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:36 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:10:37.151663 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0964d94c-1488-4fbf-9d2f-e549450d5bf3 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:37.152321 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0964d94c-1488-4fbf-9d2f-e549450d5bf3 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:37.158530 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0964d94c-1488-4fbf-9d2f-e549450d5bf3 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:37.158978 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0964d94c-1488-4fbf-9d2f-e549450d5bf3 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:37.159768 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0964d94c-1488-4fbf-9d2f-e549450d5bf3 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:37.160205 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0964d94c-1488-4fbf-9d2f-e549450d5bf3 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:37.284068 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0964d94c-1488-4fbf-9d2f-e549450d5bf3 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:37.292163 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0964d94c-1488-4fbf-9d2f-e549450d5bf3 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.144153 Jul 30 16:10:37.293579 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 273/554] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:37 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:37.500812 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f8510074-a426-4d63-aa45-66d238c5fbe2 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:37.501362 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d92d7ffe-5b19-467a-b589-7362ca85bd09 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:37.501475 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f8510074-a426-4d63-aa45-66d238c5fbe2 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:37.501957 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d92d7ffe-5b19-467a-b589-7362ca85bd09 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:37.507591 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f8510074-a426-4d63-aa45-66d238c5fbe2 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:37.507755 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d92d7ffe-5b19-467a-b589-7362ca85bd09 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:37.508041 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f8510074-a426-4d63-aa45-66d238c5fbe2 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:37.508206 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d92d7ffe-5b19-467a-b589-7362ca85bd09 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:37.508822 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f8510074-a426-4d63-aa45-66d238c5fbe2 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:37.509010 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d92d7ffe-5b19-467a-b589-7362ca85bd09 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:37.509256 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f8510074-a426-4d63-aa45-66d238c5fbe2 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:37.509362 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d92d7ffe-5b19-467a-b589-7362ca85bd09 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:37.628767 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f8510074-a426-4d63-aa45-66d238c5fbe2 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:37.629972 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d92d7ffe-5b19-467a-b589-7362ca85bd09 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:37.636749 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f8510074-a426-4d63-aa45-66d238c5fbe2 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.139641 Jul 30 16:10:37.637317 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 282/555] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:37 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:37.637729 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d92d7ffe-5b19-467a-b589-7362ca85bd09 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:37.639502 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d92d7ffe-5b19-467a-b589-7362ca85bd09 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:37.640889 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d92d7ffe-5b19-467a-b589-7362ca85bd09 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.143020 Jul 30 16:10:37.641427 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 274/556] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:37 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:38.309516 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-85c3e444-d56e-4dc8-a2b3-cf302443ee9f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:38.310635 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-85c3e444-d56e-4dc8-a2b3-cf302443ee9f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:38.316647 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-85c3e444-d56e-4dc8-a2b3-cf302443ee9f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:38.317094 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-85c3e444-d56e-4dc8-a2b3-cf302443ee9f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:38.317869 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-85c3e444-d56e-4dc8-a2b3-cf302443ee9f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:38.318293 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-85c3e444-d56e-4dc8-a2b3-cf302443ee9f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:38.485370 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-85c3e444-d56e-4dc8-a2b3-cf302443ee9f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:38.492817 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-85c3e444-d56e-4dc8-a2b3-cf302443ee9f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.187001 Jul 30 16:10:38.493659 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 283/557] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:38 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:38.653943 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-652a492f-ce5e-4947-9bdd-5456b8383417 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:38.654672 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-652a492f-ce5e-4947-9bdd-5456b8383417 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:38.657976 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a71d6bff-9e5f-4f1d-a15a-549480927f04 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:38.658589 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a71d6bff-9e5f-4f1d-a15a-549480927f04 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:38.660455 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-652a492f-ce5e-4947-9bdd-5456b8383417 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:38.660904 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-652a492f-ce5e-4947-9bdd-5456b8383417 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:38.661672 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-652a492f-ce5e-4947-9bdd-5456b8383417 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:38.662105 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-652a492f-ce5e-4947-9bdd-5456b8383417 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:38.664626 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a71d6bff-9e5f-4f1d-a15a-549480927f04 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:38.665079 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a71d6bff-9e5f-4f1d-a15a-549480927f04 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:38.665846 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a71d6bff-9e5f-4f1d-a15a-549480927f04 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:38.666283 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a71d6bff-9e5f-4f1d-a15a-549480927f04 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:38.790821 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-652a492f-ce5e-4947-9bdd-5456b8383417 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:38.797725 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a71d6bff-9e5f-4f1d-a15a-549480927f04 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:38.802664 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-652a492f-ce5e-4947-9bdd-5456b8383417 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.152784 Jul 30 16:10:38.803367 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 275/558] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:38 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:38.807340 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a71d6bff-9e5f-4f1d-a15a-549480927f04 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:38.808833 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a71d6bff-9e5f-4f1d-a15a-549480927f04 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:38.810046 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a71d6bff-9e5f-4f1d-a15a-549480927f04 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.155585 Jul 30 16:10:38.811312 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 284/559] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:38 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:39.512605 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f45c9d48-f150-43be-aba1-e968535c2177 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:39.513708 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f45c9d48-f150-43be-aba1-e968535c2177 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:39.519758 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f45c9d48-f150-43be-aba1-e968535c2177 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:39.520197 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f45c9d48-f150-43be-aba1-e968535c2177 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:39.520951 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f45c9d48-f150-43be-aba1-e968535c2177 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:39.521382 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f45c9d48-f150-43be-aba1-e968535c2177 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:39.647896 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f45c9d48-f150-43be-aba1-e968535c2177 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:39.655709 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f45c9d48-f150-43be-aba1-e968535c2177 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.146752 Jul 30 16:10:39.656288 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 276/560] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:39 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:39.820700 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b4c97e04-3744-4c0c-b5ce-85a5c9803976 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:39.821317 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b4c97e04-3744-4c0c-b5ce-85a5c9803976 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:39.827964 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b4c97e04-3744-4c0c-b5ce-85a5c9803976 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:39.828417 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b4c97e04-3744-4c0c-b5ce-85a5c9803976 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:39.828713 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8d517005-4d71-4ba4-b6b6-6272fc027b1e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:39.829187 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b4c97e04-3744-4c0c-b5ce-85a5c9803976 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:39.829334 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8d517005-4d71-4ba4-b6b6-6272fc027b1e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:39.829630 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b4c97e04-3744-4c0c-b5ce-85a5c9803976 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:39.835070 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8d517005-4d71-4ba4-b6b6-6272fc027b1e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:39.835559 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8d517005-4d71-4ba4-b6b6-6272fc027b1e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:39.836326 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8d517005-4d71-4ba4-b6b6-6272fc027b1e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:39.836765 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8d517005-4d71-4ba4-b6b6-6272fc027b1e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:39.950968 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b4c97e04-3744-4c0c-b5ce-85a5c9803976 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:39.959075 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b4c97e04-3744-4c0c-b5ce-85a5c9803976 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.141975 Jul 30 16:10:39.961861 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8d517005-4d71-4ba4-b6b6-6272fc027b1e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:39.962634 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 285/561] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:39 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:39.970275 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8d517005-4d71-4ba4-b6b6-6272fc027b1e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:39.971821 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8d517005-4d71-4ba4-b6b6-6272fc027b1e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:39.972960 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8d517005-4d71-4ba4-b6b6-6272fc027b1e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.148499 Jul 30 16:10:39.973510 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 277/562] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:39 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:40.672495 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2b4a0e94-4a9d-42d4-804a-1c2c9ca29b59 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:40.673100 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-2b4a0e94-4a9d-42d4-804a-1c2c9ca29b59 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:40.679254 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2b4a0e94-4a9d-42d4-804a-1c2c9ca29b59 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:40.679695 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2b4a0e94-4a9d-42d4-804a-1c2c9ca29b59 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:40.680451 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2b4a0e94-4a9d-42d4-804a-1c2c9ca29b59 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:40.680876 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2b4a0e94-4a9d-42d4-804a-1c2c9ca29b59 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:40.804940 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-2b4a0e94-4a9d-42d4-804a-1c2c9ca29b59 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:40.812884 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2b4a0e94-4a9d-42d4-804a-1c2c9ca29b59 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.144038 Jul 30 16:10:40.813480 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 286/563] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:40 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:40.979045 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-cd2e5f7c-e88a-4228-9ef8-c71049afec3a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:40.979689 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-cd2e5f7c-e88a-4228-9ef8-c71049afec3a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:40.986020 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cd2e5f7c-e88a-4228-9ef8-c71049afec3a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:40.986495 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cd2e5f7c-e88a-4228-9ef8-c71049afec3a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:40.987276 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cd2e5f7c-e88a-4228-9ef8-c71049afec3a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:40.987712 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cd2e5f7c-e88a-4228-9ef8-c71049afec3a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:40.991471 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8e847762-6673-495a-8913-57b8bbdfc2ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:40.992074 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-8e847762-6673-495a-8913-57b8bbdfc2ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:40.998422 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8e847762-6673-495a-8913-57b8bbdfc2ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:40.998865 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8e847762-6673-495a-8913-57b8bbdfc2ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:40.999663 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8e847762-6673-495a-8913-57b8bbdfc2ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:41.000098 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8e847762-6673-495a-8913-57b8bbdfc2ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:41.110336 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-cd2e5f7c-e88a-4228-9ef8-c71049afec3a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:41.118359 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-cd2e5f7c-e88a-4228-9ef8-c71049afec3a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.143005 Jul 30 16:10:41.119028 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 278/564] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:40 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:41.119469 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-8e847762-6673-495a-8913-57b8bbdfc2ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:41.127577 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-8e847762-6673-495a-8913-57b8bbdfc2ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:41.129183 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-8e847762-6673-495a-8913-57b8bbdfc2ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:41.130316 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8e847762-6673-495a-8913-57b8bbdfc2ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.142499 Jul 30 16:10:41.130860 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 287/565] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:40 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:41.829641 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-77866943-dfde-4b2f-8e67-53a8a60380be tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:41.830166 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-77866943-dfde-4b2f-8e67-53a8a60380be tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:41.836032 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-77866943-dfde-4b2f-8e67-53a8a60380be tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:41.836476 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-77866943-dfde-4b2f-8e67-53a8a60380be tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:41.837231 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-77866943-dfde-4b2f-8e67-53a8a60380be tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:41.837659 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-77866943-dfde-4b2f-8e67-53a8a60380be tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:41.959804 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-77866943-dfde-4b2f-8e67-53a8a60380be tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:41.967022 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-77866943-dfde-4b2f-8e67-53a8a60380be tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.141276 Jul 30 16:10:41.967611 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 279/566] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:41 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:42.135164 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-14f9c763-604b-4745-a82d-c96536aba8cb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:42.135707 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-14f9c763-604b-4745-a82d-c96536aba8cb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:42.141794 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-14f9c763-604b-4745-a82d-c96536aba8cb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:42.142246 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-14f9c763-604b-4745-a82d-c96536aba8cb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:42.143019 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-14f9c763-604b-4745-a82d-c96536aba8cb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:42.143498 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-14f9c763-604b-4745-a82d-c96536aba8cb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:42.148816 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0dd3d2a7-1d7c-42ad-a18d-abf27fcf0fd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:42.149499 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0dd3d2a7-1d7c-42ad-a18d-abf27fcf0fd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:42.155776 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0dd3d2a7-1d7c-42ad-a18d-abf27fcf0fd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:42.156222 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0dd3d2a7-1d7c-42ad-a18d-abf27fcf0fd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:42.156984 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0dd3d2a7-1d7c-42ad-a18d-abf27fcf0fd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:42.157416 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0dd3d2a7-1d7c-42ad-a18d-abf27fcf0fd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:42.263952 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-14f9c763-604b-4745-a82d-c96536aba8cb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:42.272162 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-14f9c763-604b-4745-a82d-c96536aba8cb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.140769 Jul 30 16:10:42.272772 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 288/567] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:42 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:42.278470 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0dd3d2a7-1d7c-42ad-a18d-abf27fcf0fd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:42.286793 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0dd3d2a7-1d7c-42ad-a18d-abf27fcf0fd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:42.288338 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0dd3d2a7-1d7c-42ad-a18d-abf27fcf0fd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:42.289473 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0dd3d2a7-1d7c-42ad-a18d-abf27fcf0fd3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.144292 Jul 30 16:10:42.290019 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 280/568] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:42 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:42.983963 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d7ad8c11-03f7-4251-bd09-cdb4f985e45b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:42.984575 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d7ad8c11-03f7-4251-bd09-cdb4f985e45b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:42.990399 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d7ad8c11-03f7-4251-bd09-cdb4f985e45b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:42.990876 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d7ad8c11-03f7-4251-bd09-cdb4f985e45b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:42.991673 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d7ad8c11-03f7-4251-bd09-cdb4f985e45b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:42.992103 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d7ad8c11-03f7-4251-bd09-cdb4f985e45b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:43.118592 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d7ad8c11-03f7-4251-bd09-cdb4f985e45b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:43.125860 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d7ad8c11-03f7-4251-bd09-cdb4f985e45b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.146165 Jul 30 16:10:43.126424 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 289/569] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:42 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:43.289556 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8ba8a007-0335-47ff-80e0-0592ffd2d438 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:43.290136 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8ba8a007-0335-47ff-80e0-0592ffd2d438 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:43.296369 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8ba8a007-0335-47ff-80e0-0592ffd2d438 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:43.296813 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8ba8a007-0335-47ff-80e0-0592ffd2d438 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:43.297576 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8ba8a007-0335-47ff-80e0-0592ffd2d438 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:43.298007 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8ba8a007-0335-47ff-80e0-0592ffd2d438 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:43.307271 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c4b4c63e-aecc-4c3b-b88e-e98549072fe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:43.307888 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c4b4c63e-aecc-4c3b-b88e-e98549072fe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:43.313668 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c4b4c63e-aecc-4c3b-b88e-e98549072fe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:43.314125 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c4b4c63e-aecc-4c3b-b88e-e98549072fe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:43.314897 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c4b4c63e-aecc-4c3b-b88e-e98549072fe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:43.315358 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c4b4c63e-aecc-4c3b-b88e-e98549072fe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:43.423570 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8ba8a007-0335-47ff-80e0-0592ffd2d438 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:43.431307 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8ba8a007-0335-47ff-80e0-0592ffd2d438 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.145455 Jul 30 16:10:43.432063 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 281/570] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:43 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:43.436446 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a9c0682e-fc94-4213-b381-41935a2f87f2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:10:43.442050 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a9c0682e-fc94-4213-b381-41935a2f87f2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:43.442499 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a9c0682e-fc94-4213-b381-41935a2f87f2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:43.447631 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c4b4c63e-aecc-4c3b-b88e-e98549072fe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:43.456063 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c4b4c63e-aecc-4c3b-b88e-e98549072fe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:43.457586 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c4b4c63e-aecc-4c3b-b88e-e98549072fe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:43.458725 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c4b4c63e-aecc-4c3b-b88e-e98549072fe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.155224 Jul 30 16:10:43.459309 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 290/571] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:43 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:43.504032 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a9c0682e-fc94-4213-b381-41935a2f87f2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Going to try to stop instance {{(pid=107452) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Jul 30 16:10:43.556299 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a9c0682e-fc94-4213-b381-41935a2f87f2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 202 len: 0 microversion: 2.1 time: 0.123116 Jul 30 16:10:43.556928 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 282/572] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:10:43 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:10:43.565008 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-69ddddba-1fae-4b87-b3cf-dcecdf116373 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:43.565678 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-69ddddba-1fae-4b87-b3cf-dcecdf116373 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:43.571591 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-69ddddba-1fae-4b87-b3cf-dcecdf116373 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:43.572134 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-69ddddba-1fae-4b87-b3cf-dcecdf116373 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:43.572975 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-69ddddba-1fae-4b87-b3cf-dcecdf116373 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:43.573399 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-69ddddba-1fae-4b87-b3cf-dcecdf116373 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:43.697155 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-69ddddba-1fae-4b87-b3cf-dcecdf116373 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:43.704877 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-69ddddba-1fae-4b87-b3cf-dcecdf116373 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.143457 Jul 30 16:10:43.705400 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 291/573] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:43 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:44.142769 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-db16b208-3a19-48f3-bcfe-78ecfcc0d87d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:44.143485 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-db16b208-3a19-48f3-bcfe-78ecfcc0d87d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:44.149428 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-db16b208-3a19-48f3-bcfe-78ecfcc0d87d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:44.149873 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-db16b208-3a19-48f3-bcfe-78ecfcc0d87d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:44.150728 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-db16b208-3a19-48f3-bcfe-78ecfcc0d87d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:44.151176 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-db16b208-3a19-48f3-bcfe-78ecfcc0d87d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:44.275841 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-db16b208-3a19-48f3-bcfe-78ecfcc0d87d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:44.283733 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-db16b208-3a19-48f3-bcfe-78ecfcc0d87d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.145199 Jul 30 16:10:44.284299 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 283/574] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:44 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:44.448088 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ab0336ce-d472-43e2-a01c-895c989b7408 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:44.448601 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ab0336ce-d472-43e2-a01c-895c989b7408 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:44.454518 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ab0336ce-d472-43e2-a01c-895c989b7408 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:44.454960 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ab0336ce-d472-43e2-a01c-895c989b7408 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:44.455747 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ab0336ce-d472-43e2-a01c-895c989b7408 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:44.456173 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ab0336ce-d472-43e2-a01c-895c989b7408 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:44.476977 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-bd8666b3-4513-43fc-9dda-5217466d9197 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:44.477616 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-bd8666b3-4513-43fc-9dda-5217466d9197 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:44.484082 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bd8666b3-4513-43fc-9dda-5217466d9197 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:44.484513 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bd8666b3-4513-43fc-9dda-5217466d9197 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:44.485286 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bd8666b3-4513-43fc-9dda-5217466d9197 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:44.485728 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bd8666b3-4513-43fc-9dda-5217466d9197 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:44.596289 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ab0336ce-d472-43e2-a01c-895c989b7408 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:44.604567 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ab0336ce-d472-43e2-a01c-895c989b7408 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.160164 Jul 30 16:10:44.605141 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 292/575] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:44 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:44.624125 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-bd8666b3-4513-43fc-9dda-5217466d9197 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:44.631929 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-bd8666b3-4513-43fc-9dda-5217466d9197 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:44.633628 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-bd8666b3-4513-43fc-9dda-5217466d9197 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:44.634939 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-bd8666b3-4513-43fc-9dda-5217466d9197 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.161721 Jul 30 16:10:44.635537 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 284/576] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:44 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:44.722159 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1f92f29f-1f03-42ec-8c07-19e1acfca1a2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:44.722823 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1f92f29f-1f03-42ec-8c07-19e1acfca1a2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:44.728788 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1f92f29f-1f03-42ec-8c07-19e1acfca1a2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:44.729234 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1f92f29f-1f03-42ec-8c07-19e1acfca1a2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:44.730000 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1f92f29f-1f03-42ec-8c07-19e1acfca1a2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:44.730432 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1f92f29f-1f03-42ec-8c07-19e1acfca1a2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:44.861149 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1f92f29f-1f03-42ec-8c07-19e1acfca1a2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:44.869194 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1f92f29f-1f03-42ec-8c07-19e1acfca1a2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.150956 Jul 30 16:10:44.869746 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 293/577] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:44 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:45.301156 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-5aba09c4-f3c6-4076-8dbd-ff70b87c90b4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:45.301769 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-5aba09c4-f3c6-4076-8dbd-ff70b87c90b4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:45.307628 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5aba09c4-f3c6-4076-8dbd-ff70b87c90b4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:45.308079 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5aba09c4-f3c6-4076-8dbd-ff70b87c90b4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:45.308842 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5aba09c4-f3c6-4076-8dbd-ff70b87c90b4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:45.309281 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5aba09c4-f3c6-4076-8dbd-ff70b87c90b4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:45.437059 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-5aba09c4-f3c6-4076-8dbd-ff70b87c90b4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:45.444333 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-5aba09c4-f3c6-4076-8dbd-ff70b87c90b4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1317 microversion: 2.1 time: 0.146860 Jul 30 16:10:45.444890 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 285/578] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:45 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:45.621603 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-7042de00-a420-4ded-9b59-bdb8249dc470 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:45.622142 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-7042de00-a420-4ded-9b59-bdb8249dc470 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:45.627996 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7042de00-a420-4ded-9b59-bdb8249dc470 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:45.628446 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7042de00-a420-4ded-9b59-bdb8249dc470 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:45.629209 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7042de00-a420-4ded-9b59-bdb8249dc470 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:45.629642 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7042de00-a420-4ded-9b59-bdb8249dc470 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:45.653352 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-63905a0b-8f8d-4121-8786-8935dadd69fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:45.654784 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-63905a0b-8f8d-4121-8786-8935dadd69fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:45.660661 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-63905a0b-8f8d-4121-8786-8935dadd69fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:45.661115 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-63905a0b-8f8d-4121-8786-8935dadd69fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:45.661889 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-63905a0b-8f8d-4121-8786-8935dadd69fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:45.662325 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-63905a0b-8f8d-4121-8786-8935dadd69fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:45.763987 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-7042de00-a420-4ded-9b59-bdb8249dc470 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:45.772698 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-7042de00-a420-4ded-9b59-bdb8249dc470 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.154740 Jul 30 16:10:45.773381 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 294/579] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:45 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:45.802022 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-63905a0b-8f8d-4121-8786-8935dadd69fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:45.810562 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-63905a0b-8f8d-4121-8786-8935dadd69fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:45.812064 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-63905a0b-8f8d-4121-8786-8935dadd69fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:45.813203 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-63905a0b-8f8d-4121-8786-8935dadd69fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.163588 Jul 30 16:10:45.813752 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 286/580] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:45 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:45.886928 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-698195f4-9605-4d40-90da-98755afe3455 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:45.887594 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-698195f4-9605-4d40-90da-98755afe3455 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:45.895481 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-698195f4-9605-4d40-90da-98755afe3455 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:45.896016 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-698195f4-9605-4d40-90da-98755afe3455 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:45.896738 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-698195f4-9605-4d40-90da-98755afe3455 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:45.897474 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-698195f4-9605-4d40-90da-98755afe3455 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:46.019961 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-698195f4-9605-4d40-90da-98755afe3455 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:46.027772 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-698195f4-9605-4d40-90da-98755afe3455 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.144859 Jul 30 16:10:46.028326 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 295/581] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:45 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:46.461100 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-cd134918-a844-46e6-8bf6-d8e734fcf376 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:46.461710 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-cd134918-a844-46e6-8bf6-d8e734fcf376 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:46.468230 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cd134918-a844-46e6-8bf6-d8e734fcf376 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:46.468673 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cd134918-a844-46e6-8bf6-d8e734fcf376 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:46.469436 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cd134918-a844-46e6-8bf6-d8e734fcf376 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:46.469868 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cd134918-a844-46e6-8bf6-d8e734fcf376 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:46.593220 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-cd134918-a844-46e6-8bf6-d8e734fcf376 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:46.600436 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-cd134918-a844-46e6-8bf6-d8e734fcf376 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1508 microversion: 2.1 time: 0.143047 Jul 30 16:10:46.601027 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 287/582] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:46 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1508 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:46.794176 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-35c0549e-1dfc-455c-a7cd-747c13bb1f0c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:46.794830 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-35c0549e-1dfc-455c-a7cd-747c13bb1f0c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:46.806428 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-35c0549e-1dfc-455c-a7cd-747c13bb1f0c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:46.806876 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-35c0549e-1dfc-455c-a7cd-747c13bb1f0c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:46.807678 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-35c0549e-1dfc-455c-a7cd-747c13bb1f0c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:46.808120 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-35c0549e-1dfc-455c-a7cd-747c13bb1f0c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:46.834483 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-416df404-6723-4ba7-a554-6db125f541a7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:46.835215 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-416df404-6723-4ba7-a554-6db125f541a7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:46.843087 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-416df404-6723-4ba7-a554-6db125f541a7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:46.843977 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-416df404-6723-4ba7-a554-6db125f541a7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:46.844919 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-416df404-6723-4ba7-a554-6db125f541a7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:46.845526 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-416df404-6723-4ba7-a554-6db125f541a7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:46.968001 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-35c0549e-1dfc-455c-a7cd-747c13bb1f0c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:46.977088 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-35c0549e-1dfc-455c-a7cd-747c13bb1f0c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.189574 Jul 30 16:10:46.977906 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 296/583] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:46 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:47.005013 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-416df404-6723-4ba7-a554-6db125f541a7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:47.012777 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-416df404-6723-4ba7-a554-6db125f541a7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:47.014875 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-416df404-6723-4ba7-a554-6db125f541a7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:47.016300 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-416df404-6723-4ba7-a554-6db125f541a7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.185676 Jul 30 16:10:47.016850 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 288/584] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:46 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:10:47.045112 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-bfc72881-a17a-4b12-a0e2-e3d9cf664370 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:47.045808 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-bfc72881-a17a-4b12-a0e2-e3d9cf664370 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:47.051554 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bfc72881-a17a-4b12-a0e2-e3d9cf664370 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:47.051997 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bfc72881-a17a-4b12-a0e2-e3d9cf664370 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:47.052757 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bfc72881-a17a-4b12-a0e2-e3d9cf664370 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:47.053187 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bfc72881-a17a-4b12-a0e2-e3d9cf664370 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:47.172939 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-bfc72881-a17a-4b12-a0e2-e3d9cf664370 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:47.180665 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-bfc72881-a17a-4b12-a0e2-e3d9cf664370 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.139344 Jul 30 16:10:47.181231 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 297/585] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:47 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:47.911481 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b709f584-c17b-4ea1-9aad-8c184e9d3785 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:47.911980 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b709f584-c17b-4ea1-9aad-8c184e9d3785 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:47.917989 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b709f584-c17b-4ea1-9aad-8c184e9d3785 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:47.918436 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b709f584-c17b-4ea1-9aad-8c184e9d3785 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:47.919800 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b709f584-c17b-4ea1-9aad-8c184e9d3785 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:47.920242 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b709f584-c17b-4ea1-9aad-8c184e9d3785 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:47.928831 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-7cb3b272-1402-4301-a550-1d91a94e4613 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77b7e3b8-6feb-430a-8ca1-ae5b69e379c1"}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:10:47.929931 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-7cb3b272-1402-4301-a550-1d91a94e4613 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:47.936375 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7cb3b272-1402-4301-a550-1d91a94e4613 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:47.936853 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7cb3b272-1402-4301-a550-1d91a94e4613 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:47.937625 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7cb3b272-1402-4301-a550-1d91a94e4613 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:47.938058 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7cb3b272-1402-4301-a550-1d91a94e4613 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:48.004633 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.objects.instance [None req-b709f584-c17b-4ea1-9aad-8c184e9d3785 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lazy-loading 'services' on Instance uuid 96da483e-dc7d-4c23-b608-22490f6b4b4a {{(pid=107452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:10:48.073357 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b709f584-c17b-4ea1-9aad-8c184e9d3785 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "DELETE /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a/os-volume_attachments/cec09d66-f1e4-4019-a648-50c7401c0f10" status: 202 len: 0 microversion: 2.1 time: 0.165733 Jul 30 16:10:48.073997 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 289/586] 10.222.0.37 () {58 vars in 1416 bytes} [Fri Jul 30 16:10:47 2021] DELETE /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a/os-volume_attachments/cec09d66-f1e4-4019-a648-50c7401c0f10 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:10:48.078937 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-aa2f9b13-cbf6-41a3-b8f8-a988aac07e5f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:48.079647 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-aa2f9b13-cbf6-41a3-b8f8-a988aac07e5f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:48.085895 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aa2f9b13-cbf6-41a3-b8f8-a988aac07e5f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:48.086347 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aa2f9b13-cbf6-41a3-b8f8-a988aac07e5f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:48.087115 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aa2f9b13-cbf6-41a3-b8f8-a988aac07e5f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:48.087580 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aa2f9b13-cbf6-41a3-b8f8-a988aac07e5f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:48.229095 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-aa2f9b13-cbf6-41a3-b8f8-a988aac07e5f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:48.231240 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-7cb3b272-1402-4301-a550-1d91a94e4613 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "POST /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305689 Jul 30 16:10:48.232361 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 298/587] 10.222.0.37 () {60 vars in 1323 bytes} [Fri Jul 30 16:10:47 2021] POST /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:10:48.238804 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-7eb0a3f7-a67d-4a1c-bad7-84c8caa26885 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:48.239613 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-7eb0a3f7-a67d-4a1c-bad7-84c8caa26885 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:48.241283 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-aa2f9b13-cbf6-41a3-b8f8-a988aac07e5f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.166004 Jul 30 16:10:48.241690 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 290/588] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:48 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:48.248247 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-cfcbdccf-64f7-408c-bb90-7b118ab07c30 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:48.249112 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-cfcbdccf-64f7-408c-bb90-7b118ab07c30 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:48.255620 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cfcbdccf-64f7-408c-bb90-7b118ab07c30 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:48.256285 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cfcbdccf-64f7-408c-bb90-7b118ab07c30 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:48.257217 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cfcbdccf-64f7-408c-bb90-7b118ab07c30 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:48.257805 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cfcbdccf-64f7-408c-bb90-7b118ab07c30 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:48.260326 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7eb0a3f7-a67d-4a1c-bad7-84c8caa26885 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:48.261070 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7eb0a3f7-a67d-4a1c-bad7-84c8caa26885 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:48.262441 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7eb0a3f7-a67d-4a1c-bad7-84c8caa26885 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:48.264083 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7eb0a3f7-a67d-4a1c-bad7-84c8caa26885 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:48.396642 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-cfcbdccf-64f7-408c-bb90-7b118ab07c30 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:48.404196 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-7eb0a3f7-a67d-4a1c-bad7-84c8caa26885 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:48.404568 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-cfcbdccf-64f7-408c-bb90-7b118ab07c30 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.161016 Jul 30 16:10:48.405138 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 291/589] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:48 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:48.411851 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-7eb0a3f7-a67d-4a1c-bad7-84c8caa26885 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:48.413329 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-7eb0a3f7-a67d-4a1c-bad7-84c8caa26885 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:48.414438 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-7eb0a3f7-a67d-4a1c-bad7-84c8caa26885 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.180918 Jul 30 16:10:48.414970 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 299/590] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:48 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:10:49.258244 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-eb381130-59f0-4ab2-98f7-fbf6a5549248 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:49.258781 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-eb381130-59f0-4ab2-98f7-fbf6a5549248 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:49.265530 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-eb381130-59f0-4ab2-98f7-fbf6a5549248 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:49.266237 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-eb381130-59f0-4ab2-98f7-fbf6a5549248 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:49.267020 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-eb381130-59f0-4ab2-98f7-fbf6a5549248 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:49.267485 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-eb381130-59f0-4ab2-98f7-fbf6a5549248 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:49.390027 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-eb381130-59f0-4ab2-98f7-fbf6a5549248 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:49.397931 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-eb381130-59f0-4ab2-98f7-fbf6a5549248 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.143435 Jul 30 16:10:49.398493 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 292/591] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:49 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:49.422053 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a210cd48-5287-4b69-93f6-97f2607ce7fe tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:49.422661 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a210cd48-5287-4b69-93f6-97f2607ce7fe tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:49.429090 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a210cd48-5287-4b69-93f6-97f2607ce7fe tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:49.429541 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a210cd48-5287-4b69-93f6-97f2607ce7fe tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:49.430345 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a210cd48-5287-4b69-93f6-97f2607ce7fe tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:49.430775 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a210cd48-5287-4b69-93f6-97f2607ce7fe tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:49.433182 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1fb99984-7a63-48f7-96c8-faaa72e629ab tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:49.433799 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1fb99984-7a63-48f7-96c8-faaa72e629ab tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:49.440495 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1fb99984-7a63-48f7-96c8-faaa72e629ab tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:49.440949 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1fb99984-7a63-48f7-96c8-faaa72e629ab tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:49.441732 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1fb99984-7a63-48f7-96c8-faaa72e629ab tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:49.442165 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1fb99984-7a63-48f7-96c8-faaa72e629ab tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:49.554059 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a210cd48-5287-4b69-93f6-97f2607ce7fe tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:49.562469 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a210cd48-5287-4b69-93f6-97f2607ce7fe tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.144977 Jul 30 16:10:49.563040 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 300/592] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:49 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:49.563959 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1fb99984-7a63-48f7-96c8-faaa72e629ab tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:49.571899 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1fb99984-7a63-48f7-96c8-faaa72e629ab tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:49.573666 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1fb99984-7a63-48f7-96c8-faaa72e629ab tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:49.574939 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1fb99984-7a63-48f7-96c8-faaa72e629ab tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.145509 Jul 30 16:10:49.576274 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 293/593] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:49 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:50.414447 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-baba9bf8-8491-4e31-a072-fab00fb24d52 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:50.415056 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-baba9bf8-8491-4e31-a072-fab00fb24d52 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:50.421465 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-baba9bf8-8491-4e31-a072-fab00fb24d52 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:50.421915 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-baba9bf8-8491-4e31-a072-fab00fb24d52 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:50.422693 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-baba9bf8-8491-4e31-a072-fab00fb24d52 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:50.423239 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-baba9bf8-8491-4e31-a072-fab00fb24d52 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:50.540813 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-baba9bf8-8491-4e31-a072-fab00fb24d52 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:50.551904 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-baba9bf8-8491-4e31-a072-fab00fb24d52 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1567 microversion: 2.1 time: 0.141041 Jul 30 16:10:50.552477 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 301/594] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:50 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1567 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:50.579736 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-7a5d66ad-302a-4a72-9047-0c49620da216 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:50.580347 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7a5d66ad-302a-4a72-9047-0c49620da216 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:50.586293 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7a5d66ad-302a-4a72-9047-0c49620da216 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:50.586740 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7a5d66ad-302a-4a72-9047-0c49620da216 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:50.587519 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7a5d66ad-302a-4a72-9047-0c49620da216 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:50.587948 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7a5d66ad-302a-4a72-9047-0c49620da216 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:50.593262 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0cd1a2a5-fc28-428b-8dfc-913dde5c8fe4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:50.593870 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0cd1a2a5-fc28-428b-8dfc-913dde5c8fe4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:50.601005 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0cd1a2a5-fc28-428b-8dfc-913dde5c8fe4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:50.601436 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0cd1a2a5-fc28-428b-8dfc-913dde5c8fe4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:50.602203 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0cd1a2a5-fc28-428b-8dfc-913dde5c8fe4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:50.602631 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0cd1a2a5-fc28-428b-8dfc-913dde5c8fe4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:50.710063 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-7a5d66ad-302a-4a72-9047-0c49620da216 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:50.719109 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-7a5d66ad-302a-4a72-9047-0c49620da216 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.143430 Jul 30 16:10:50.730171 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 294/595] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:50 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:50.737612 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0cd1a2a5-fc28-428b-8dfc-913dde5c8fe4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:50.746345 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0cd1a2a5-fc28-428b-8dfc-913dde5c8fe4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:50.748282 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0cd1a2a5-fc28-428b-8dfc-913dde5c8fe4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:50.749500 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0cd1a2a5-fc28-428b-8dfc-913dde5c8fe4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.159807 Jul 30 16:10:50.750361 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 302/596] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:50 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:51.334582 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-dfcfb7a1-1d8a-4af3-b67c-2e79064aedba tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:51.335221 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-dfcfb7a1-1d8a-4af3-b67c-2e79064aedba tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:51.342159 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dfcfb7a1-1d8a-4af3-b67c-2e79064aedba tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:51.342616 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dfcfb7a1-1d8a-4af3-b67c-2e79064aedba tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:51.343406 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dfcfb7a1-1d8a-4af3-b67c-2e79064aedba tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:51.343844 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dfcfb7a1-1d8a-4af3-b67c-2e79064aedba tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:51.465700 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-dfcfb7a1-1d8a-4af3-b67c-2e79064aedba tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:51.475015 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-dfcfb7a1-1d8a-4af3-b67c-2e79064aedba tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1594 microversion: 2.1 time: 0.144024 Jul 30 16:10:51.475608 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 295/597] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:51 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1594 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:51.569247 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8b450a15-ed9a-415b-a6d9-a8afc133e596 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:51.569855 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-8b450a15-ed9a-415b-a6d9-a8afc133e596 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:51.576781 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8b450a15-ed9a-415b-a6d9-a8afc133e596 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:51.577229 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8b450a15-ed9a-415b-a6d9-a8afc133e596 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:51.577994 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8b450a15-ed9a-415b-a6d9-a8afc133e596 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:51.578432 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8b450a15-ed9a-415b-a6d9-a8afc133e596 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:51.705550 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-8b450a15-ed9a-415b-a6d9-a8afc133e596 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:51.713303 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8b450a15-ed9a-415b-a6d9-a8afc133e596 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1547 microversion: 2.1 time: 0.147625 Jul 30 16:10:51.713871 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 303/598] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:51 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:51.729991 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a2edf86c-2bc8-4d1b-a2a8-2d6045108aac tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:51.730543 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a2edf86c-2bc8-4d1b-a2a8-2d6045108aac tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:51.736305 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a2edf86c-2bc8-4d1b-a2a8-2d6045108aac tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:51.736750 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a2edf86c-2bc8-4d1b-a2a8-2d6045108aac tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:51.737521 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a2edf86c-2bc8-4d1b-a2a8-2d6045108aac tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:51.737762 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-51c80543-5a19-4e07-ba2a-8d8e3bd25f90 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:51.737947 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a2edf86c-2bc8-4d1b-a2a8-2d6045108aac tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:51.738383 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-51c80543-5a19-4e07-ba2a-8d8e3bd25f90 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:51.744213 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-51c80543-5a19-4e07-ba2a-8d8e3bd25f90 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:51.744665 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-51c80543-5a19-4e07-ba2a-8d8e3bd25f90 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:51.745447 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-51c80543-5a19-4e07-ba2a-8d8e3bd25f90 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:51.745888 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-51c80543-5a19-4e07-ba2a-8d8e3bd25f90 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:51.827051 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-a2edf86c-2bc8-4d1b-a2a8-2d6045108aac tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] HTTP exception thrown: Cannot 'detach_volume' instance f429942e-bf01-4d55-9cb0-29cdf5d6fef6 while it is in vm_state rescued Jul 30 16:10:51.827873 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a2edf86c-2bc8-4d1b-a2a8-2d6045108aac tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Returning 409 to user: Cannot 'detach_volume' instance f429942e-bf01-4d55-9cb0-29cdf5d6fef6 while it is in vm_state rescued {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:10:51.828721 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a2edf86c-2bc8-4d1b-a2a8-2d6045108aac tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "DELETE /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6/os-volume_attachments/f42b4fc8-550c-4a0a-a678-2e5fa8aeecb8" status: 409 len: 152 microversion: 2.1 time: 0.102627 Jul 30 16:10:51.832535 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 296/599] 10.222.0.37 () {58 vars in 1416 bytes} [Fri Jul 30 16:10:51 2021] DELETE /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6/os-volume_attachments/f42b4fc8-550c-4a0a-a678-2e5fa8aeecb8 => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 16:10:51.834220 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-be29de2f-0147-4ea2-a0e8-8d2eb2ff4df0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:51.834825 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-be29de2f-0147-4ea2-a0e8-8d2eb2ff4df0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:51.841483 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-be29de2f-0147-4ea2-a0e8-8d2eb2ff4df0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:51.841932 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-be29de2f-0147-4ea2-a0e8-8d2eb2ff4df0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:51.842708 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-be29de2f-0147-4ea2-a0e8-8d2eb2ff4df0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:51.843416 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-be29de2f-0147-4ea2-a0e8-8d2eb2ff4df0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:51.883430 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-51c80543-5a19-4e07-ba2a-8d8e3bd25f90 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:51.896528 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-51c80543-5a19-4e07-ba2a-8d8e3bd25f90 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.162459 Jul 30 16:10:51.906800 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 304/600] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:51 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:51.911419 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3700515f-5085-4ab5-b3bc-7b9b558bdbad tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:10:51.912192 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-3700515f-5085-4ab5-b3bc-7b9b558bdbad tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:51.918111 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3700515f-5085-4ab5-b3bc-7b9b558bdbad tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:51.918652 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3700515f-5085-4ab5-b3bc-7b9b558bdbad tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:51.919584 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3700515f-5085-4ab5-b3bc-7b9b558bdbad tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:51.920106 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3700515f-5085-4ab5-b3bc-7b9b558bdbad tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:51.994154 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-3700515f-5085-4ab5-b3bc-7b9b558bdbad tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "POST /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6/action" status: 202 len: 0 microversion: 2.1 time: 0.086801 Jul 30 16:10:51.994984 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 305/601] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:10:51 2021] POST /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:10:52.003163 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-de317c31-91b5-41fd-933d-f9c15f1e1e2b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:52.003875 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-de317c31-91b5-41fd-933d-f9c15f1e1e2b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:52.010694 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-de317c31-91b5-41fd-933d-f9c15f1e1e2b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:52.011162 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-de317c31-91b5-41fd-933d-f9c15f1e1e2b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:52.011954 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-de317c31-91b5-41fd-933d-f9c15f1e1e2b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:52.012393 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-de317c31-91b5-41fd-933d-f9c15f1e1e2b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:52.058158 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-be29de2f-0147-4ea2-a0e8-8d2eb2ff4df0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:52.066874 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-be29de2f-0147-4ea2-a0e8-8d2eb2ff4df0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:52.068692 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-be29de2f-0147-4ea2-a0e8-8d2eb2ff4df0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:52.070111 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-be29de2f-0147-4ea2-a0e8-8d2eb2ff4df0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.239618 Jul 30 16:10:52.071284 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 297/602] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:51 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:10:52.154997 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-de317c31-91b5-41fd-933d-f9c15f1e1e2b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:52.163108 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-de317c31-91b5-41fd-933d-f9c15f1e1e2b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1555 microversion: 2.1 time: 0.163823 Jul 30 16:10:52.163698 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 306/603] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:51 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:52.380791 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0f1c5414-ac4d-4a07-8a86-058bac5834b3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:52.381862 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0f1c5414-ac4d-4a07-8a86-058bac5834b3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:52.388737 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0f1c5414-ac4d-4a07-8a86-058bac5834b3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:52.389256 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0f1c5414-ac4d-4a07-8a86-058bac5834b3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:52.390047 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0f1c5414-ac4d-4a07-8a86-058bac5834b3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:52.390484 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0f1c5414-ac4d-4a07-8a86-058bac5834b3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:52.429924 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0f1c5414-ac4d-4a07-8a86-058bac5834b3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Going to try to terminate instance {{(pid=107452) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:10:52.538292 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0f1c5414-ac4d-4a07-8a86-058bac5834b3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "DELETE /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 204 len: 0 microversion: 2.1 time: 0.160825 Jul 30 16:10:52.542257 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 298/604] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:10:52 2021] DELETE /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 16:10:52.550344 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-df6c60d7-7ac9-4658-bc10-cb6fe8676db8 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:52.550968 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-df6c60d7-7ac9-4658-bc10-cb6fe8676db8 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:52.558603 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-df6c60d7-7ac9-4658-bc10-cb6fe8676db8 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:52.559052 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-df6c60d7-7ac9-4658-bc10-cb6fe8676db8 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:52.560465 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-df6c60d7-7ac9-4658-bc10-cb6fe8676db8 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:52.561136 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-df6c60d7-7ac9-4658-bc10-cb6fe8676db8 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:52.683566 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-df6c60d7-7ac9-4658-bc10-cb6fe8676db8 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:52.691416 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-df6c60d7-7ac9-4658-bc10-cb6fe8676db8 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 200 len: 1513 microversion: 2.1 time: 0.147819 Jul 30 16:10:52.691968 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 307/605] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:52 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:52.914276 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-778c1090-50c0-4a5b-9a06-f004a44f954e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:52.915841 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-778c1090-50c0-4a5b-9a06-f004a44f954e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:52.922500 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-778c1090-50c0-4a5b-9a06-f004a44f954e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:52.923230 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-778c1090-50c0-4a5b-9a06-f004a44f954e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:52.924176 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-778c1090-50c0-4a5b-9a06-f004a44f954e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:52.924933 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-778c1090-50c0-4a5b-9a06-f004a44f954e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:53.088321 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-470dff3a-236f-4030-8bdf-d2be26b1ff22 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:53.088936 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-470dff3a-236f-4030-8bdf-d2be26b1ff22 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:53.095619 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-470dff3a-236f-4030-8bdf-d2be26b1ff22 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:53.096151 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-470dff3a-236f-4030-8bdf-d2be26b1ff22 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:53.096858 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-470dff3a-236f-4030-8bdf-d2be26b1ff22 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:53.097545 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-470dff3a-236f-4030-8bdf-d2be26b1ff22 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:53.227735 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-470dff3a-236f-4030-8bdf-d2be26b1ff22 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:53.236792 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-470dff3a-236f-4030-8bdf-d2be26b1ff22 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:53.238377 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-470dff3a-236f-4030-8bdf-d2be26b1ff22 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:53.239654 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-470dff3a-236f-4030-8bdf-d2be26b1ff22 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1743 microversion: 2.20 time: 0.155287 Jul 30 16:10:53.240305 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 308/606] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:53 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:10:53.244510 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-95c995a9-ce22-4c95-8424-9362f33c6645 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:53.245211 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-95c995a9-ce22-4c95-8424-9362f33c6645 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:53.252662 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95c995a9-ce22-4c95-8424-9362f33c6645 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:53.253106 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95c995a9-ce22-4c95-8424-9362f33c6645 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:53.253873 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95c995a9-ce22-4c95-8424-9362f33c6645 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:53.254300 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95c995a9-ce22-4c95-8424-9362f33c6645 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:53.325872 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-778c1090-50c0-4a5b-9a06-f004a44f954e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:53.333944 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-778c1090-50c0-4a5b-9a06-f004a44f954e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.423735 Jul 30 16:10:53.344626 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 299/607] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:52 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:53.387254 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-95c995a9-ce22-4c95-8424-9362f33c6645 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:53.396502 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-95c995a9-ce22-4c95-8424-9362f33c6645 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1555 microversion: 2.1 time: 0.155116 Jul 30 16:10:53.397288 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 309/608] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:53 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:53.708886 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-91e876b5-2a17-4011-92c2-2315a380b7a5 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:53.709537 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-91e876b5-2a17-4011-92c2-2315a380b7a5 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:53.715306 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-91e876b5-2a17-4011-92c2-2315a380b7a5 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:53.715759 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-91e876b5-2a17-4011-92c2-2315a380b7a5 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:53.717071 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-91e876b5-2a17-4011-92c2-2315a380b7a5 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:53.717512 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-91e876b5-2a17-4011-92c2-2315a380b7a5 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:53.908337 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-91e876b5-2a17-4011-92c2-2315a380b7a5 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:53.919237 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-91e876b5-2a17-4011-92c2-2315a380b7a5 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 200 len: 1513 microversion: 2.1 time: 0.213869 Jul 30 16:10:53.928687 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 300/609] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:53 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 1513 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:53.941702 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-1810ab06-4ca8-4638-b7ca-114e9ed4e6b3 req-6d2436a2-5168-47e8-aa17-9418100d61c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb0becf-8d14-4c6b-8b46-82c09b52a5a6", "tag": "be55314f-44d9-47f6-87fd-5d73fbe32ff7"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:10:53.943548 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:10:53.943548 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:10:53.951038 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-1810ab06-4ca8-4638-b7ca-114e9ed4e6b3 req-6d2436a2-5168-47e8-aa17-9418100d61c5 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:53.951507 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-1810ab06-4ca8-4638-b7ca-114e9ed4e6b3 req-6d2436a2-5168-47e8-aa17-9418100d61c5 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:53.962762 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-1810ab06-4ca8-4638-b7ca-114e9ed4e6b3 req-6d2436a2-5168-47e8-aa17-9418100d61c5 service nova] Creating event network-changed:be55314f-44d9-47f6-87fd-5d73fbe32ff7 for instance 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 on hv-cinder-80304 Jul 30 16:10:53.968492 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-1810ab06-4ca8-4638-b7ca-114e9ed4e6b3 req-6d2436a2-5168-47e8-aa17-9418100d61c5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030556 Jul 30 16:10:53.969770 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 310/610] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:10:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:10:54.259198 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0cd5afe9-61fc-46ec-aa55-78ae2375fb46 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:54.260070 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0cd5afe9-61fc-46ec-aa55-78ae2375fb46 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:54.274367 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0cd5afe9-61fc-46ec-aa55-78ae2375fb46 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:54.275061 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0cd5afe9-61fc-46ec-aa55-78ae2375fb46 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:54.276057 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0cd5afe9-61fc-46ec-aa55-78ae2375fb46 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:54.276783 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0cd5afe9-61fc-46ec-aa55-78ae2375fb46 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:54.352455 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3fccc408-713f-4684-ac99-e5d64b7c36c1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:54.353314 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-3fccc408-713f-4684-ac99-e5d64b7c36c1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:54.360946 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3fccc408-713f-4684-ac99-e5d64b7c36c1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:54.363694 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3fccc408-713f-4684-ac99-e5d64b7c36c1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:54.365020 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3fccc408-713f-4684-ac99-e5d64b7c36c1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:54.365648 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3fccc408-713f-4684-ac99-e5d64b7c36c1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:54.464127 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0cd5afe9-61fc-46ec-aa55-78ae2375fb46 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:54.474394 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0cd5afe9-61fc-46ec-aa55-78ae2375fb46 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:54.476810 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0cd5afe9-61fc-46ec-aa55-78ae2375fb46 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:54.478179 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0cd5afe9-61fc-46ec-aa55-78ae2375fb46 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1743 microversion: 2.20 time: 0.223150 Jul 30 16:10:54.478897 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 301/611] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:54 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1743 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:54.486280 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-5f818d50-0640-4151-bec0-c3f85c67ea5d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:54.487170 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-5f818d50-0640-4151-bec0-c3f85c67ea5d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:54.495659 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5f818d50-0640-4151-bec0-c3f85c67ea5d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:54.496425 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5f818d50-0640-4151-bec0-c3f85c67ea5d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:54.497643 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5f818d50-0640-4151-bec0-c3f85c67ea5d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:54.498243 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5f818d50-0640-4151-bec0-c3f85c67ea5d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:54.626454 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3fccc408-713f-4684-ac99-e5d64b7c36c1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:54.643869 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-3fccc408-713f-4684-ac99-e5d64b7c36c1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.290916 Jul 30 16:10:54.654240 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 311/612] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:54 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:54.816625 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-5f818d50-0640-4151-bec0-c3f85c67ea5d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:54.825785 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-5f818d50-0640-4151-bec0-c3f85c67ea5d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1555 microversion: 2.1 time: 0.345284 Jul 30 16:10:54.828401 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 302/613] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:54 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1555 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:54.935979 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-19a2084b-7f04-46bb-b66f-7f96d0c2bc2a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:54.937076 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-19a2084b-7f04-46bb-b66f-7f96d0c2bc2a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:54.955169 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-19a2084b-7f04-46bb-b66f-7f96d0c2bc2a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:54.956460 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-19a2084b-7f04-46bb-b66f-7f96d0c2bc2a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:54.957699 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-19a2084b-7f04-46bb-b66f-7f96d0c2bc2a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:54.958462 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-19a2084b-7f04-46bb-b66f-7f96d0c2bc2a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:55.116971 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-19a2084b-7f04-46bb-b66f-7f96d0c2bc2a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:55.125567 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-19a2084b-7f04-46bb-b66f-7f96d0c2bc2a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 200 len: 1513 microversion: 2.1 time: 0.194024 Jul 30 16:10:55.126335 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 312/614] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:54 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:55.186535 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-00d2481c-e9e4-49c6-b1bd-1086a64900d8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1824267616"}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:10:55.187298 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-00d2481c-e9e4-49c6-b1bd-1086a64900d8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:55.193422 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-00d2481c-e9e4-49c6-b1bd-1086a64900d8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:55.193881 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-00d2481c-e9e4-49c6-b1bd-1086a64900d8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:55.194723 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-00d2481c-e9e4-49c6-b1bd-1086a64900d8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:55.195242 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-00d2481c-e9e4-49c6-b1bd-1086a64900d8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:55.338881 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-1ffe9db6-4aa5-4909-8d12-b57e1ca407a7 req-908e114a-32c5-441f-82ab-2d678577f607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb", "name": "network-vif-plugged", "status": "completed", "tag": "9138d528-69f5-4703-ba07-6f85b67dc617"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:10:55.340550 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:10:55.340550 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:10:55.344213 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.network.security_group_api [None req-00d2481c-e9e4-49c6-b1bd-1086a64900d8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Adding security group 9e4ad6e6-0dd6-4ead-909d-5555aa5d6d92 to port be55314f-44d9-47f6-87fd-5d73fbe32ff7 Jul 30 16:10:55.348010 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-1ffe9db6-4aa5-4909-8d12-b57e1ca407a7 req-908e114a-32c5-441f-82ab-2d678577f607 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:55.348642 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-1ffe9db6-4aa5-4909-8d12-b57e1ca407a7 req-908e114a-32c5-441f-82ab-2d678577f607 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:55.365017 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-1ffe9db6-4aa5-4909-8d12-b57e1ca407a7 req-908e114a-32c5-441f-82ab-2d678577f607 service nova] Creating event network-vif-plugged:9138d528-69f5-4703-ba07-6f85b67dc617 for instance ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb on hv-cinder-80304 Jul 30 16:10:55.374474 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-1ffe9db6-4aa5-4909-8d12-b57e1ca407a7 req-908e114a-32c5-441f-82ab-2d678577f607 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041548 Jul 30 16:10:55.375078 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 313/615] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:10:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:10:55.497983 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-66b21b93-a868-4918-8f0e-29426d745735 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:55.498677 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-66b21b93-a868-4918-8f0e-29426d745735 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:55.505079 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-66b21b93-a868-4918-8f0e-29426d745735 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:55.505607 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-66b21b93-a868-4918-8f0e-29426d745735 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:55.506460 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-66b21b93-a868-4918-8f0e-29426d745735 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:55.507073 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-66b21b93-a868-4918-8f0e-29426d745735 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:55.642088 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-66b21b93-a868-4918-8f0e-29426d745735 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:55.652662 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-66b21b93-a868-4918-8f0e-29426d745735 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:55.655813 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-66b21b93-a868-4918-8f0e-29426d745735 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:55.657144 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-66b21b93-a868-4918-8f0e-29426d745735 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1738 microversion: 2.20 time: 0.164037 Jul 30 16:10:55.658044 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 314/616] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:55 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:10:55.664527 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3068bc40-ed00-4a4a-a437-54d073f637ca tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:55.665662 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-3068bc40-ed00-4a4a-a437-54d073f637ca tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:55.674186 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3068bc40-ed00-4a4a-a437-54d073f637ca tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:55.674789 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3068bc40-ed00-4a4a-a437-54d073f637ca tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:55.675705 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3068bc40-ed00-4a4a-a437-54d073f637ca tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:55.676243 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3068bc40-ed00-4a4a-a437-54d073f637ca tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:55.764835 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-00d2481c-e9e4-49c6-b1bd-1086a64900d8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "POST /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/action" status: 202 len: 0 microversion: 2.1 time: 0.582788 Jul 30 16:10:55.765452 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 303/617] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:10:55 2021] POST /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:10:55.773871 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a38aadf4-b6e0-4ba1-86cf-425612b38874 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:55.774492 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a38aadf4-b6e0-4ba1-86cf-425612b38874 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:55.788405 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a38aadf4-b6e0-4ba1-86cf-425612b38874 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:55.788859 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a38aadf4-b6e0-4ba1-86cf-425612b38874 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:55.789691 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a38aadf4-b6e0-4ba1-86cf-425612b38874 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:55.790139 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a38aadf4-b6e0-4ba1-86cf-425612b38874 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:55.889904 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3068bc40-ed00-4a4a-a437-54d073f637ca tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:55.905926 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-3068bc40-ed00-4a4a-a437-54d073f637ca tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.245809 Jul 30 16:10:55.906516 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 315/618] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:55 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:55.927248 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-90c4c4d5-c6eb-444a-921f-416566c8594e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:55.927897 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-90c4c4d5-c6eb-444a-921f-416566c8594e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:55.938703 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-90c4c4d5-c6eb-444a-921f-416566c8594e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:55.939180 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-90c4c4d5-c6eb-444a-921f-416566c8594e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:55.939977 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-90c4c4d5-c6eb-444a-921f-416566c8594e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:55.940415 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-90c4c4d5-c6eb-444a-921f-416566c8594e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:56.082097 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-a38aadf4-b6e0-4ba1-86cf-425612b38874 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:56.091908 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a38aadf4-b6e0-4ba1-86cf-425612b38874 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1759 microversion: 2.1 time: 0.321270 Jul 30 16:10:56.095012 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 304/619] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:55 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1759 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:56.099841 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-9a19f6d1-0630-4497-b6e1-9cb4ed13d4e7 req-2adb9d21-74bb-445a-8e1e-f1e6d46e207a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb0becf-8d14-4c6b-8b46-82c09b52a5a6", "tag": "be55314f-44d9-47f6-87fd-5d73fbe32ff7"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:10:56.101591 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:10:56.101591 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:10:56.125214 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-9a19f6d1-0630-4497-b6e1-9cb4ed13d4e7 req-2adb9d21-74bb-445a-8e1e-f1e6d46e207a service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:56.129884 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-9a19f6d1-0630-4497-b6e1-9cb4ed13d4e7 req-2adb9d21-74bb-445a-8e1e-f1e6d46e207a service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:56.164089 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-9a19f6d1-0630-4497-b6e1-9cb4ed13d4e7 req-2adb9d21-74bb-445a-8e1e-f1e6d46e207a service nova] Creating event network-changed:be55314f-44d9-47f6-87fd-5d73fbe32ff7 for instance 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 on hv-cinder-80304 Jul 30 16:10:56.171004 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-90c4c4d5-c6eb-444a-921f-416566c8594e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:56.171592 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-9a19f6d1-0630-4497-b6e1-9cb4ed13d4e7 req-2adb9d21-74bb-445a-8e1e-f1e6d46e207a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074440 Jul 30 16:10:56.173051 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 305/620] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:10:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:10:56.180080 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-dc41aa68-13c4-48d2-b182-88d0d9e75cf4 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:56.180974 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-dc41aa68-13c4-48d2-b182-88d0d9e75cf4 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:56.182306 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-90c4c4d5-c6eb-444a-921f-416566c8594e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1555 microversion: 2.1 time: 0.274308 Jul 30 16:10:56.183306 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 316/621] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:55 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1555 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:56.188602 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dc41aa68-13c4-48d2-b182-88d0d9e75cf4 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:56.190096 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dc41aa68-13c4-48d2-b182-88d0d9e75cf4 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:56.191048 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dc41aa68-13c4-48d2-b182-88d0d9e75cf4 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:56.191649 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dc41aa68-13c4-48d2-b182-88d0d9e75cf4 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:56.398526 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-dc41aa68-13c4-48d2-b182-88d0d9e75cf4 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:56.408696 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-dc41aa68-13c4-48d2-b182-88d0d9e75cf4 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 200 len: 1513 microversion: 2.1 time: 0.234264 Jul 30 16:10:56.419343 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 306/622] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:56 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 1513 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:56.679536 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e4d8bf5d-e4b6-4232-bfef-31633da1f202 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:56.679536 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e4d8bf5d-e4b6-4232-bfef-31633da1f202 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:56.695289 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e4d8bf5d-e4b6-4232-bfef-31633da1f202 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:56.695898 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e4d8bf5d-e4b6-4232-bfef-31633da1f202 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:56.696965 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e4d8bf5d-e4b6-4232-bfef-31633da1f202 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:56.697619 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e4d8bf5d-e4b6-4232-bfef-31633da1f202 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:56.897638 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e4d8bf5d-e4b6-4232-bfef-31633da1f202 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:56.905769 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e4d8bf5d-e4b6-4232-bfef-31633da1f202 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:56.907539 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e4d8bf5d-e4b6-4232-bfef-31633da1f202 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:56.908946 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e4d8bf5d-e4b6-4232-bfef-31633da1f202 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1738 microversion: 2.20 time: 0.235162 Jul 30 16:10:56.909654 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 317/623] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:56 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:10:56.922082 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a5ec666f-2c6b-4c56-833e-1fd6bbff6164 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:56.922701 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a5ec666f-2c6b-4c56-833e-1fd6bbff6164 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:56.929731 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a5ec666f-2c6b-4c56-833e-1fd6bbff6164 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:56.930159 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a5ec666f-2c6b-4c56-833e-1fd6bbff6164 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:56.930948 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a5ec666f-2c6b-4c56-833e-1fd6bbff6164 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:56.933847 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a5ec666f-2c6b-4c56-833e-1fd6bbff6164 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:57.118587 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-a5ec666f-2c6b-4c56-833e-1fd6bbff6164 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:57.142753 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a5ec666f-2c6b-4c56-833e-1fd6bbff6164 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.223527 Jul 30 16:10:57.143667 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 307/624] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:56 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:57.200320 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b1d33d51-ac5c-420c-8f29-8864a65f710c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:57.201699 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b1d33d51-ac5c-420c-8f29-8864a65f710c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:57.208120 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b1d33d51-ac5c-420c-8f29-8864a65f710c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:57.209003 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b1d33d51-ac5c-420c-8f29-8864a65f710c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:57.210012 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b1d33d51-ac5c-420c-8f29-8864a65f710c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:57.210904 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b1d33d51-ac5c-420c-8f29-8864a65f710c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:57.426104 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a6580318-d22e-4254-b74e-4e3c160c484d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:57.426910 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a6580318-d22e-4254-b74e-4e3c160c484d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:57.433227 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a6580318-d22e-4254-b74e-4e3c160c484d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:57.433664 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a6580318-d22e-4254-b74e-4e3c160c484d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:57.434435 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a6580318-d22e-4254-b74e-4e3c160c484d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:57.435088 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a6580318-d22e-4254-b74e-4e3c160c484d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:57.492367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b1d33d51-ac5c-420c-8f29-8864a65f710c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:57.525234 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b1d33d51-ac5c-420c-8f29-8864a65f710c tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1555 microversion: 2.1 time: 0.328139 Jul 30 16:10:57.536257 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 318/625] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:57 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1555 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:57.636235 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-a6580318-d22e-4254-b74e-4e3c160c484d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:57.645938 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a6580318-d22e-4254-b74e-4e3c160c484d tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 200 len: 1513 microversion: 2.1 time: 0.224349 Jul 30 16:10:57.659851 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 308/626] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:57 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:57.768194 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-be96f3da-02c8-465f-9ae9-d2a227d704f4 req-7b205349-1d82-43e7-87b6-efc26a0c8726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96da483e-dc7d-4c23-b608-22490f6b4b4a", "name": "network-vif-deleted", "tag": "49f42183-504d-4e4f-9f31-34ca7e547fa0"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:10:57.770509 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:10:57.770509 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:10:57.779457 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-be96f3da-02c8-465f-9ae9-d2a227d704f4 req-7b205349-1d82-43e7-87b6-efc26a0c8726 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:57.780197 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-be96f3da-02c8-465f-9ae9-d2a227d704f4 req-7b205349-1d82-43e7-87b6-efc26a0c8726 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:57.792136 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-be96f3da-02c8-465f-9ae9-d2a227d704f4 req-7b205349-1d82-43e7-87b6-efc26a0c8726 service nova] Creating event network-vif-deleted:49f42183-504d-4e4f-9f31-34ca7e547fa0 for instance 96da483e-dc7d-4c23-b608-22490f6b4b4a on hv-cinder-80304 Jul 30 16:10:57.800192 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-be96f3da-02c8-465f-9ae9-d2a227d704f4 req-7b205349-1d82-43e7-87b6-efc26a0c8726 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041115 Jul 30 16:10:57.800741 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 319/627] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:10:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:10:57.928141 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-7d17a6d6-27f8-4b0d-98f2-bc318e483e4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:57.929093 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7d17a6d6-27f8-4b0d-98f2-bc318e483e4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:57.940757 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7d17a6d6-27f8-4b0d-98f2-bc318e483e4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:57.941633 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7d17a6d6-27f8-4b0d-98f2-bc318e483e4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:57.942651 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7d17a6d6-27f8-4b0d-98f2-bc318e483e4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:57.943275 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7d17a6d6-27f8-4b0d-98f2-bc318e483e4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:58.102237 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-7d17a6d6-27f8-4b0d-98f2-bc318e483e4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:58.114211 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-7d17a6d6-27f8-4b0d-98f2-bc318e483e4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:58.116739 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-7d17a6d6-27f8-4b0d-98f2-bc318e483e4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:58.117965 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-7d17a6d6-27f8-4b0d-98f2-bc318e483e4e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1738 microversion: 2.20 time: 0.193818 Jul 30 16:10:58.119806 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 309/628] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:57 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:10:58.161102 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-bf5316c1-f537-451b-9d6f-04c8c9197276 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:58.161904 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-bf5316c1-f537-451b-9d6f-04c8c9197276 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:58.168316 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bf5316c1-f537-451b-9d6f-04c8c9197276 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:58.169089 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bf5316c1-f537-451b-9d6f-04c8c9197276 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:58.170587 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bf5316c1-f537-451b-9d6f-04c8c9197276 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:58.171024 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bf5316c1-f537-451b-9d6f-04c8c9197276 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:58.305905 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-bf5316c1-f537-451b-9d6f-04c8c9197276 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:58.315908 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-bf5316c1-f537-451b-9d6f-04c8c9197276 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.158947 Jul 30 16:10:58.316480 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 320/629] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:58 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:58.545310 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-7b5cee27-8dc6-446c-a822-dfee3effc04f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:58.545924 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7b5cee27-8dc6-446c-a822-dfee3effc04f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:58.551904 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7b5cee27-8dc6-446c-a822-dfee3effc04f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:58.552470 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7b5cee27-8dc6-446c-a822-dfee3effc04f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:58.553245 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7b5cee27-8dc6-446c-a822-dfee3effc04f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:58.553677 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7b5cee27-8dc6-446c-a822-dfee3effc04f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:58.663790 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9f87a065-a08f-4569-9920-024536ac703f tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:58.664588 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9f87a065-a08f-4569-9920-024536ac703f tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:58.673671 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9f87a065-a08f-4569-9920-024536ac703f tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:58.674133 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9f87a065-a08f-4569-9920-024536ac703f tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:58.674933 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9f87a065-a08f-4569-9920-024536ac703f tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:58.675422 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9f87a065-a08f-4569-9920-024536ac703f tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:58.712658 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9f87a065-a08f-4569-9920-024536ac703f tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:58.713365 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9f87a065-a08f-4569-9920-024536ac703f tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:58.714045 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.objects.instance [None req-9f87a065-a08f-4569-9920-024536ac703f tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lazy-loading 'fault' on Instance uuid 96da483e-dc7d-4c23-b608-22490f6b4b4a {{(pid=107453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:10:58.732730 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-7b5cee27-8dc6-446c-a822-dfee3effc04f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:58.746557 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-7b5cee27-8dc6-446c-a822-dfee3effc04f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1561 microversion: 2.1 time: 0.206090 Jul 30 16:10:58.750753 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 310/630] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:58 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1561 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:10:58.761690 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9f87a065-a08f-4569-9920-024536ac703f tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:58.772119 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9f87a065-a08f-4569-9920-024536ac703f tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 200 len: 1308 microversion: 2.1 time: 0.113086 Jul 30 16:10:58.784700 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 321/631] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:58 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 1308 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:58.855518 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-655d6282-0106-4d93-91ec-d156c4bdf109 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:58.868142 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-655d6282-0106-4d93-91ec-d156c4bdf109 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:58.875799 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-655d6282-0106-4d93-91ec-d156c4bdf109 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:58.876254 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-655d6282-0106-4d93-91ec-d156c4bdf109 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:58.877063 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-655d6282-0106-4d93-91ec-d156c4bdf109 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:58.877504 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-655d6282-0106-4d93-91ec-d156c4bdf109 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:59.051315 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.objects.instance [None req-655d6282-0106-4d93-91ec-d156c4bdf109 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lazy-loading 'services' on Instance uuid f429942e-bf01-4d55-9cb0-29cdf5d6fef6 {{(pid=107452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:10:59.124736 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-655d6282-0106-4d93-91ec-d156c4bdf109 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "DELETE /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6/os-volume_attachments/f42b4fc8-550c-4a0a-a678-2e5fa8aeecb8" status: 202 len: 0 microversion: 2.1 time: 0.273332 Jul 30 16:10:59.125484 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 311/632] 10.222.0.37 () {58 vars in 1416 bytes} [Fri Jul 30 16:10:58 2021] DELETE /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6/os-volume_attachments/f42b4fc8-550c-4a0a-a678-2e5fa8aeecb8 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:10:59.138012 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a1402ac4-2d15-4a25-996f-fe6d358ac7f8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:59.138569 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a1402ac4-2d15-4a25-996f-fe6d358ac7f8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:59.153866 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a1402ac4-2d15-4a25-996f-fe6d358ac7f8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:59.154319 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a1402ac4-2d15-4a25-996f-fe6d358ac7f8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:59.156321 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a1402ac4-2d15-4a25-996f-fe6d358ac7f8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:59.157078 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a1402ac4-2d15-4a25-996f-fe6d358ac7f8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:59.326367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a1402ac4-2d15-4a25-996f-fe6d358ac7f8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:59.336936 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a1402ac4-2d15-4a25-996f-fe6d358ac7f8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:59.337898 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e61f6618-632f-40e1-95c7-965769a75095 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:59.338673 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e61f6618-632f-40e1-95c7-965769a75095 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:59.339246 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a1402ac4-2d15-4a25-996f-fe6d358ac7f8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:59.340652 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a1402ac4-2d15-4a25-996f-fe6d358ac7f8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1738 microversion: 2.20 time: 0.206547 Jul 30 16:10:59.342414 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 322/633] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:10:59 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:10:59.358768 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e61f6618-632f-40e1-95c7-965769a75095 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:59.359277 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e61f6618-632f-40e1-95c7-965769a75095 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:59.360080 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e61f6618-632f-40e1-95c7-965769a75095 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:59.360516 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e61f6618-632f-40e1-95c7-965769a75095 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:59.508339 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e61f6618-632f-40e1-95c7-965769a75095 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:10:59.518129 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e61f6618-632f-40e1-95c7-965769a75095 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.187345 Jul 30 16:10:59.527053 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 312/634] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:59 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:10:59.790681 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-95c492d5-7900-4190-93ec-f10210478cb6 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:10:59.791349 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-95c492d5-7900-4190-93ec-f10210478cb6 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: 96da483e-dc7d-4c23-b608-22490f6b4b4a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:10:59.798700 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95c492d5-7900-4190-93ec-f10210478cb6 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:59.799267 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95c492d5-7900-4190-93ec-f10210478cb6 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:59.800278 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95c492d5-7900-4190-93ec-f10210478cb6 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:10:59.800746 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95c492d5-7900-4190-93ec-f10210478cb6 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:10:59.816308 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-95c492d5-7900-4190-93ec-f10210478cb6 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] HTTP exception thrown: Instance 96da483e-dc7d-4c23-b608-22490f6b4b4a could not be found. Jul 30 16:10:59.817204 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-95c492d5-7900-4190-93ec-f10210478cb6 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Returning 404 to user: Instance 96da483e-dc7d-4c23-b608-22490f6b4b4a could not be found. {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:10:59.818068 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-95c492d5-7900-4190-93ec-f10210478cb6 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a" status: 404 len: 111 microversion: 2.1 time: 0.031735 Jul 30 16:10:59.818615 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 323/635] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:10:59 2021] GET /compute/v2.1/servers/96da483e-dc7d-4c23-b608-22490f6b4b4a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:11:00.361476 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-7df540c2-9f83-41f3-af94-0c605e191723 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:00.363486 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7df540c2-9f83-41f3-af94-0c605e191723 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:00.370060 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7df540c2-9f83-41f3-af94-0c605e191723 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:00.370802 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7df540c2-9f83-41f3-af94-0c605e191723 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:00.371819 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7df540c2-9f83-41f3-af94-0c605e191723 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:00.372893 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7df540c2-9f83-41f3-af94-0c605e191723 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:00.516838 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-7df540c2-9f83-41f3-af94-0c605e191723 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:00.525025 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-7df540c2-9f83-41f3-af94-0c605e191723 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:00.526800 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-7df540c2-9f83-41f3-af94-0c605e191723 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:00.527963 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-7df540c2-9f83-41f3-af94-0c605e191723 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1738 microversion: 2.20 time: 0.171990 Jul 30 16:11:00.529041 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 313/636] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:00 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:00.540521 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-dfac9f1c-4f2b-462c-aa8b-eb688b701967 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:00.541847 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-dfac9f1c-4f2b-462c-aa8b-eb688b701967 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:00.557331 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-dfac9f1c-4f2b-462c-aa8b-eb688b701967 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:00.558210 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-dfac9f1c-4f2b-462c-aa8b-eb688b701967 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:00.559848 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-dfac9f1c-4f2b-462c-aa8b-eb688b701967 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:00.560470 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-dfac9f1c-4f2b-462c-aa8b-eb688b701967 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:00.708030 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-dfac9f1c-4f2b-462c-aa8b-eb688b701967 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:00.720199 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-dfac9f1c-4f2b-462c-aa8b-eb688b701967 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.185395 Jul 30 16:11:00.720775 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 324/637] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:00 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:01.275194 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6ee67739-a74c-4eec-945c-07ce8312e287 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:01.275705 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6ee67739-a74c-4eec-945c-07ce8312e287 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:01.282437 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6ee67739-a74c-4eec-945c-07ce8312e287 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:01.282830 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6ee67739-a74c-4eec-945c-07ce8312e287 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:01.283636 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6ee67739-a74c-4eec-945c-07ce8312e287 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:01.284249 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6ee67739-a74c-4eec-945c-07ce8312e287 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:01.381683 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.objects.instance [None req-6ee67739-a74c-4eec-945c-07ce8312e287 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lazy-loading 'services' on Instance uuid 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa {{(pid=107452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:11:01.455661 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6ee67739-a74c-4eec-945c-07ce8312e287 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "DELETE /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa/os-volume_attachments/77b7e3b8-6feb-430a-8ca1-ae5b69e379c1" status: 202 len: 0 microversion: 2.1 time: 0.186604 Jul 30 16:11:01.456824 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 314/638] 10.222.0.37 () {58 vars in 1416 bytes} [Fri Jul 30 16:11:01 2021] DELETE /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa/os-volume_attachments/77b7e3b8-6feb-430a-8ca1-ae5b69e379c1 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:11:01.548822 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1c9f2d20-353b-4478-b2c1-fda2dc972c49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:01.550052 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1c9f2d20-353b-4478-b2c1-fda2dc972c49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:01.556327 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1c9f2d20-353b-4478-b2c1-fda2dc972c49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:01.557082 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1c9f2d20-353b-4478-b2c1-fda2dc972c49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:01.558036 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1c9f2d20-353b-4478-b2c1-fda2dc972c49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:01.558637 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1c9f2d20-353b-4478-b2c1-fda2dc972c49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:01.689870 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1c9f2d20-353b-4478-b2c1-fda2dc972c49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:01.699895 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1c9f2d20-353b-4478-b2c1-fda2dc972c49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:01.701880 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1c9f2d20-353b-4478-b2c1-fda2dc972c49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:01.703193 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1c9f2d20-353b-4478-b2c1-fda2dc972c49 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1738 microversion: 2.20 time: 0.158423 Jul 30 16:11:01.703863 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 325/639] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:01 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:01.738662 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-5344b5d7-06b6-4da6-8a52-d67dbd5dc9c9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:01.739430 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-5344b5d7-06b6-4da6-8a52-d67dbd5dc9c9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:01.746116 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5344b5d7-06b6-4da6-8a52-d67dbd5dc9c9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:01.746570 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5344b5d7-06b6-4da6-8a52-d67dbd5dc9c9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:01.747414 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5344b5d7-06b6-4da6-8a52-d67dbd5dc9c9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:01.747886 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5344b5d7-06b6-4da6-8a52-d67dbd5dc9c9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:02.088343 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-5344b5d7-06b6-4da6-8a52-d67dbd5dc9c9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:02.096621 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-5344b5d7-06b6-4da6-8a52-d67dbd5dc9c9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.362494 Jul 30 16:11:02.098377 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 315/640] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:01 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:02.726239 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-40fc84fe-a605-4cb7-b4eb-a1d3bf0c342a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:02.727557 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-40fc84fe-a605-4cb7-b4eb-a1d3bf0c342a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:02.734872 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-40fc84fe-a605-4cb7-b4eb-a1d3bf0c342a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:02.735675 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-40fc84fe-a605-4cb7-b4eb-a1d3bf0c342a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:02.736470 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-40fc84fe-a605-4cb7-b4eb-a1d3bf0c342a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:02.736907 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-40fc84fe-a605-4cb7-b4eb-a1d3bf0c342a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:02.879407 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-40fc84fe-a605-4cb7-b4eb-a1d3bf0c342a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:02.888732 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-40fc84fe-a605-4cb7-b4eb-a1d3bf0c342a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:02.890787 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-40fc84fe-a605-4cb7-b4eb-a1d3bf0c342a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:02.892940 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-40fc84fe-a605-4cb7-b4eb-a1d3bf0c342a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1738 microversion: 2.20 time: 0.171320 Jul 30 16:11:02.904206 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 326/641] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:02 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:03.115760 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1196df4a-38cb-4a04-9141-da59978ae859 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:03.116466 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1196df4a-38cb-4a04-9141-da59978ae859 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:03.124258 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1196df4a-38cb-4a04-9141-da59978ae859 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:03.124717 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1196df4a-38cb-4a04-9141-da59978ae859 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:03.125499 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1196df4a-38cb-4a04-9141-da59978ae859 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:03.125930 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1196df4a-38cb-4a04-9141-da59978ae859 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:03.260331 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1196df4a-38cb-4a04-9141-da59978ae859 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:03.270566 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1196df4a-38cb-4a04-9141-da59978ae859 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.158376 Jul 30 16:11:03.271163 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 316/642] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:03 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:03.911730 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e13671a7-0e33-4b84-b487-b74daa366382 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:03.912357 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e13671a7-0e33-4b84-b487-b74daa366382 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:03.920082 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e13671a7-0e33-4b84-b487-b74daa366382 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:03.920784 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e13671a7-0e33-4b84-b487-b74daa366382 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:03.921802 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e13671a7-0e33-4b84-b487-b74daa366382 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:03.922237 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e13671a7-0e33-4b84-b487-b74daa366382 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:04.051419 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e13671a7-0e33-4b84-b487-b74daa366382 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:04.062037 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e13671a7-0e33-4b84-b487-b74daa366382 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:04.063951 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e13671a7-0e33-4b84-b487-b74daa366382 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:04.065100 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e13671a7-0e33-4b84-b487-b74daa366382 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1738 microversion: 2.20 time: 0.157076 Jul 30 16:11:04.065683 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 327/643] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:03 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:04.288181 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b242068a-e35d-410a-abc4-c9f79120002e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:04.289007 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b242068a-e35d-410a-abc4-c9f79120002e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:04.298491 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b242068a-e35d-410a-abc4-c9f79120002e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:04.299019 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b242068a-e35d-410a-abc4-c9f79120002e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:04.300367 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b242068a-e35d-410a-abc4-c9f79120002e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:04.300822 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b242068a-e35d-410a-abc4-c9f79120002e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:04.441275 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b242068a-e35d-410a-abc4-c9f79120002e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:04.449582 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b242068a-e35d-410a-abc4-c9f79120002e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.164993 Jul 30 16:11:04.450083 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 317/644] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:04 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:05.084117 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3f717eb4-aa60-4187-9de6-aadc22b4fbec tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:05.085364 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-3f717eb4-aa60-4187-9de6-aadc22b4fbec tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:05.091878 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3f717eb4-aa60-4187-9de6-aadc22b4fbec tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:05.092331 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3f717eb4-aa60-4187-9de6-aadc22b4fbec tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:05.093125 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3f717eb4-aa60-4187-9de6-aadc22b4fbec tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:05.093733 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3f717eb4-aa60-4187-9de6-aadc22b4fbec tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:05.253570 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3f717eb4-aa60-4187-9de6-aadc22b4fbec tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:05.261454 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3f717eb4-aa60-4187-9de6-aadc22b4fbec tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:05.263540 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3f717eb4-aa60-4187-9de6-aadc22b4fbec tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:05.264980 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-3f717eb4-aa60-4187-9de6-aadc22b4fbec tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1738 microversion: 2.20 time: 0.185013 Jul 30 16:11:05.265930 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 328/645] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:05 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:05.466677 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b13beb08-ed02-4a85-88cc-a82b53f36bc9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:05.467862 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b13beb08-ed02-4a85-88cc-a82b53f36bc9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:05.473713 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b13beb08-ed02-4a85-88cc-a82b53f36bc9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:05.474159 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b13beb08-ed02-4a85-88cc-a82b53f36bc9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:05.474956 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b13beb08-ed02-4a85-88cc-a82b53f36bc9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:05.475424 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b13beb08-ed02-4a85-88cc-a82b53f36bc9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:05.604263 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b13beb08-ed02-4a85-88cc-a82b53f36bc9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:05.613435 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b13beb08-ed02-4a85-88cc-a82b53f36bc9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.151340 Jul 30 16:11:05.617311 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 318/646] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:05 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:06.283158 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-6b276602-3c32-4221-9a43-8a0ab69cf452 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:06.283796 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-6b276602-3c32-4221-9a43-8a0ab69cf452 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:06.289673 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6b276602-3c32-4221-9a43-8a0ab69cf452 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:06.290126 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6b276602-3c32-4221-9a43-8a0ab69cf452 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:06.290900 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6b276602-3c32-4221-9a43-8a0ab69cf452 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:06.291361 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6b276602-3c32-4221-9a43-8a0ab69cf452 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:06.417357 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6b276602-3c32-4221-9a43-8a0ab69cf452 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:06.425666 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6b276602-3c32-4221-9a43-8a0ab69cf452 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:06.427168 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6b276602-3c32-4221-9a43-8a0ab69cf452 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:06.428328 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-6b276602-3c32-4221-9a43-8a0ab69cf452 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1738 microversion: 2.20 time: 0.149045 Jul 30 16:11:06.428873 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 329/647] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:06 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:06.630046 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a12eeada-7742-44cc-b9db-5cda3e321ee5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:06.631456 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a12eeada-7742-44cc-b9db-5cda3e321ee5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:06.639092 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a12eeada-7742-44cc-b9db-5cda3e321ee5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:06.639578 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a12eeada-7742-44cc-b9db-5cda3e321ee5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:06.640339 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a12eeada-7742-44cc-b9db-5cda3e321ee5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:06.640773 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a12eeada-7742-44cc-b9db-5cda3e321ee5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:06.765166 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-a12eeada-7742-44cc-b9db-5cda3e321ee5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:06.774862 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a12eeada-7742-44cc-b9db-5cda3e321ee5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.148978 Jul 30 16:11:06.775725 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 319/648] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:06 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:07.448237 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9bbf4377-b4c5-4fcf-b877-13e17cc5c852 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:07.448770 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9bbf4377-b4c5-4fcf-b877-13e17cc5c852 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:07.454726 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9bbf4377-b4c5-4fcf-b877-13e17cc5c852 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:07.455197 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9bbf4377-b4c5-4fcf-b877-13e17cc5c852 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:07.455963 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9bbf4377-b4c5-4fcf-b877-13e17cc5c852 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:07.456389 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9bbf4377-b4c5-4fcf-b877-13e17cc5c852 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:07.578295 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9bbf4377-b4c5-4fcf-b877-13e17cc5c852 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:07.585916 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9bbf4377-b4c5-4fcf-b877-13e17cc5c852 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:07.587426 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9bbf4377-b4c5-4fcf-b877-13e17cc5c852 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:07.588549 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9bbf4377-b4c5-4fcf-b877-13e17cc5c852 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1720 microversion: 2.20 time: 0.144193 Jul 30 16:11:07.589090 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 330/649] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:07 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1720 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:11:07.792887 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a26bdc0a-3d38-4abb-89b0-9a0346225994 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:07.793500 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a26bdc0a-3d38-4abb-89b0-9a0346225994 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:07.800103 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a26bdc0a-3d38-4abb-89b0-9a0346225994 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:07.800555 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a26bdc0a-3d38-4abb-89b0-9a0346225994 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:07.801321 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a26bdc0a-3d38-4abb-89b0-9a0346225994 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:07.801753 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a26bdc0a-3d38-4abb-89b0-9a0346225994 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:07.918833 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-a26bdc0a-3d38-4abb-89b0-9a0346225994 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:07.927331 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a26bdc0a-3d38-4abb-89b0-9a0346225994 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.138097 Jul 30 16:11:07.927896 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 320/650] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:07 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:08.608036 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9e22d135-3df5-4612-b04b-bd25defa359d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:08.608582 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9e22d135-3df5-4612-b04b-bd25defa359d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:08.614672 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9e22d135-3df5-4612-b04b-bd25defa359d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:08.615124 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9e22d135-3df5-4612-b04b-bd25defa359d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:08.615919 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9e22d135-3df5-4612-b04b-bd25defa359d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:08.616352 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9e22d135-3df5-4612-b04b-bd25defa359d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:08.738630 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9e22d135-3df5-4612-b04b-bd25defa359d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:08.746266 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9e22d135-3df5-4612-b04b-bd25defa359d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:08.747926 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9e22d135-3df5-4612-b04b-bd25defa359d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:08.749052 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9e22d135-3df5-4612-b04b-bd25defa359d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1720 microversion: 2.20 time: 0.145398 Jul 30 16:11:08.749607 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 331/651] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:08 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1720 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:11:08.943620 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-da130176-a86b-4b36-bc54-69615b6c7a12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:08.944153 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-da130176-a86b-4b36-bc54-69615b6c7a12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:08.950002 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-da130176-a86b-4b36-bc54-69615b6c7a12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:08.950952 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-da130176-a86b-4b36-bc54-69615b6c7a12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:08.951857 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-da130176-a86b-4b36-bc54-69615b6c7a12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:08.952292 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-da130176-a86b-4b36-bc54-69615b6c7a12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:09.075227 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-da130176-a86b-4b36-bc54-69615b6c7a12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:09.083896 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-da130176-a86b-4b36-bc54-69615b6c7a12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.143979 Jul 30 16:11:09.084451 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 321/652] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:08 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:09.766367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-5d849453-1da6-42ba-86ca-26cd145d0eba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:09.766973 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-5d849453-1da6-42ba-86ca-26cd145d0eba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:09.772723 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5d849453-1da6-42ba-86ca-26cd145d0eba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:09.773162 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5d849453-1da6-42ba-86ca-26cd145d0eba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:09.773913 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5d849453-1da6-42ba-86ca-26cd145d0eba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:09.774343 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5d849453-1da6-42ba-86ca-26cd145d0eba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:09.891653 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-5d849453-1da6-42ba-86ca-26cd145d0eba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:09.899350 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-5d849453-1da6-42ba-86ca-26cd145d0eba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:09.900837 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-5d849453-1da6-42ba-86ca-26cd145d0eba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:09.902530 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-5d849453-1da6-42ba-86ca-26cd145d0eba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1720 microversion: 2.20 time: 0.139928 Jul 30 16:11:09.903948 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 332/653] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:09 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1720 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:10.100445 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-38ef398a-29b8-437d-8862-b84e2843d972 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:10.101052 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-38ef398a-29b8-437d-8862-b84e2843d972 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:10.107377 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-38ef398a-29b8-437d-8862-b84e2843d972 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:10.108012 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-38ef398a-29b8-437d-8862-b84e2843d972 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:10.108781 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-38ef398a-29b8-437d-8862-b84e2843d972 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:10.109216 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-38ef398a-29b8-437d-8862-b84e2843d972 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:10.227724 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-38ef398a-29b8-437d-8862-b84e2843d972 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:10.235452 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-38ef398a-29b8-437d-8862-b84e2843d972 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.138622 Jul 30 16:11:10.236099 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 322/654] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:10 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:10.739385 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-fb974946-9fb7-4c32-8cae-6b8d928884bd req-77c4c41f-7ec6-41cd-8d03-d27cca42bfaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb", "name": "network-vif-unplugged", "status": "completed", "tag": "9138d528-69f5-4703-ba07-6f85b67dc617"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:11:10.740999 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:11:10.740999 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:11:10.748888 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-fb974946-9fb7-4c32-8cae-6b8d928884bd req-77c4c41f-7ec6-41cd-8d03-d27cca42bfaf service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:10.749407 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-fb974946-9fb7-4c32-8cae-6b8d928884bd req-77c4c41f-7ec6-41cd-8d03-d27cca42bfaf service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:10.762406 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-fb974946-9fb7-4c32-8cae-6b8d928884bd req-77c4c41f-7ec6-41cd-8d03-d27cca42bfaf service nova] Creating event network-vif-unplugged:9138d528-69f5-4703-ba07-6f85b67dc617 for instance ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb on hv-cinder-80304 Jul 30 16:11:10.768402 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-fb974946-9fb7-4c32-8cae-6b8d928884bd req-77c4c41f-7ec6-41cd-8d03-d27cca42bfaf service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032768 Jul 30 16:11:10.769138 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 333/655] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:11:10 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:11:10.922815 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-52829cb2-b825-4be0-9fca-155e63bfed7c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:10.923372 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-52829cb2-b825-4be0-9fca-155e63bfed7c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:10.929118 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-52829cb2-b825-4be0-9fca-155e63bfed7c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:10.929564 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-52829cb2-b825-4be0-9fca-155e63bfed7c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:10.930325 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-52829cb2-b825-4be0-9fca-155e63bfed7c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:10.930769 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-52829cb2-b825-4be0-9fca-155e63bfed7c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:11.050888 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-52829cb2-b825-4be0-9fca-155e63bfed7c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:11.059042 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-52829cb2-b825-4be0-9fca-155e63bfed7c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:11.061224 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-52829cb2-b825-4be0-9fca-155e63bfed7c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:11.062423 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-52829cb2-b825-4be0-9fca-155e63bfed7c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1720 microversion: 2.20 time: 0.144125 Jul 30 16:11:11.063035 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 323/656] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:10 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1720 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:11.252674 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c2444e59-746a-41fa-8c7b-9d4f8099107b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:11.253484 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c2444e59-746a-41fa-8c7b-9d4f8099107b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:11.260062 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c2444e59-746a-41fa-8c7b-9d4f8099107b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:11.260508 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c2444e59-746a-41fa-8c7b-9d4f8099107b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:11.261271 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c2444e59-746a-41fa-8c7b-9d4f8099107b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:11.261770 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c2444e59-746a-41fa-8c7b-9d4f8099107b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:11.384926 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c2444e59-746a-41fa-8c7b-9d4f8099107b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:11.392897 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c2444e59-746a-41fa-8c7b-9d4f8099107b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.144175 Jul 30 16:11:11.393444 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 334/657] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:11 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:11.794143 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-795c9169-ffb0-40a9-affa-8aaa8561b956 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1218644688", "imageRef": "eea29a7d-10c3-489a-adee-10be2e7a26bd", "flavorRef": "452", "networks": [{"uuid": "1532ae73-edd4-48ea-b12b-b0dca0c66e2a"}]}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:11:11.847633 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.network.neutron [None req-795c9169-ffb0-40a9-affa-8aaa8561b956 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] validate_networks() for [('1532ae73-edd4-48ea-b12b-b0dca0c66e2a', None, None, None)] {{(pid=107452) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:11:12.081283 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1ad1073d-9d78-4be6-8274-455fd76916ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:12.081883 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1ad1073d-9d78-4be6-8274-455fd76916ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:12.087753 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1ad1073d-9d78-4be6-8274-455fd76916ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:12.088214 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1ad1073d-9d78-4be6-8274-455fd76916ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:12.089053 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1ad1073d-9d78-4be6-8274-455fd76916ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:12.089511 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1ad1073d-9d78-4be6-8274-455fd76916ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:12.192090 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-795c9169-ffb0-40a9-affa-8aaa8561b956 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Flavor limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:11:12.192584 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-795c9169-ffb0-40a9-affa-8aaa8561b956 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Image limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:11:12.193259 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-795c9169-ffb0-40a9-affa-8aaa8561b956 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Flavor pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:11:12.193887 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-795c9169-ffb0-40a9-affa-8aaa8561b956 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Image pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:11:12.194392 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-795c9169-ffb0-40a9-affa-8aaa8561b956 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:11:12.204467 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-795c9169-ffb0-40a9-affa-8aaa8561b956 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:12.206319 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-795c9169-ffb0-40a9-affa-8aaa8561b956 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:12.206319 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-795c9169-ffb0-40a9-affa-8aaa8561b956 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:12.209624 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-795c9169-ffb0-40a9-affa-8aaa8561b956 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:12.227841 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-795c9169-ffb0-40a9-affa-8aaa8561b956 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Getting quotas for project e2bbd6beaee8450d825abd418910d05c. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:11:12.229930 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1ad1073d-9d78-4be6-8274-455fd76916ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:12.232142 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-795c9169-ffb0-40a9-affa-8aaa8561b956 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Getting quotas for user 5ce25fb105324bd3a8216f224b2251d8 and project e2bbd6beaee8450d825abd418910d05c. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:11:12.237817 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1ad1073d-9d78-4be6-8274-455fd76916ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:12.239393 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1ad1073d-9d78-4be6-8274-455fd76916ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:12.240511 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1ad1073d-9d78-4be6-8274-455fd76916ae tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1720 microversion: 2.20 time: 0.163141 Jul 30 16:11:12.241095 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 335/658] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:12 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:11:12.245413 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4dfa4a6b-bf17-4034-a9c4-384d5024b6e1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:12.245919 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4dfa4a6b-bf17-4034-a9c4-384d5024b6e1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:12.247986 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-795c9169-ffb0-40a9-affa-8aaa8561b956 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Going to run 1 instances... {{(pid=107452) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:11:12.250452 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-795c9169-ffb0-40a9-affa-8aaa8561b956 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eea29a7d-10c3-489a-adee-10be2e7a26bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:11:12.252241 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4dfa4a6b-bf17-4034-a9c4-384d5024b6e1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:12.252693 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4dfa4a6b-bf17-4034-a9c4-384d5024b6e1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:12.253460 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4dfa4a6b-bf17-4034-a9c4-384d5024b6e1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:12.253892 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4dfa4a6b-bf17-4034-a9c4-384d5024b6e1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:12.279196 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4dfa4a6b-bf17-4034-a9c4-384d5024b6e1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Going to try to terminate instance {{(pid=107453) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:11:12.297024 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-795c9169-ffb0-40a9-affa-8aaa8561b956 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506584 Jul 30 16:11:12.297665 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 324/659] 10.222.0.37 () {60 vars in 1147 bytes} [Fri Jul 30 16:11:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 16:11:12.305927 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-43a8512a-cc35-496b-9825-c8bb817f2ddf tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:12.306510 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-43a8512a-cc35-496b-9825-c8bb817f2ddf tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:12.314029 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-43a8512a-cc35-496b-9825-c8bb817f2ddf tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:12.314489 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-43a8512a-cc35-496b-9825-c8bb817f2ddf tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:12.315305 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-43a8512a-cc35-496b-9825-c8bb817f2ddf tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:12.316099 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-43a8512a-cc35-496b-9825-c8bb817f2ddf tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:12.340439 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-43a8512a-cc35-496b-9825-c8bb817f2ddf tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Going to try to terminate instance {{(pid=107452) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:11:12.372867 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4dfa4a6b-bf17-4034-a9c4-384d5024b6e1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "DELETE /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 204 len: 0 microversion: 2.1 time: 0.129904 Jul 30 16:11:12.378367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 336/660] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:11:12 2021] DELETE /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 16:11:12.383959 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a57ba12d-6bf4-4d7e-8556-04508f63ff8e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:12.384708 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a57ba12d-6bf4-4d7e-8556-04508f63ff8e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:12.425962 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-43a8512a-cc35-496b-9825-c8bb817f2ddf tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "DELETE /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 204 len: 0 microversion: 2.1 time: 0.125483 Jul 30 16:11:12.426540 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 325/661] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:11:12 2021] DELETE /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 16:11:12.432063 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-2bde99dd-cb84-462b-a405-a5728d702647 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:12.432759 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-2bde99dd-cb84-462b-a405-a5728d702647 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:12.440195 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2bde99dd-cb84-462b-a405-a5728d702647 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:12.440770 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2bde99dd-cb84-462b-a405-a5728d702647 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:12.441412 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2bde99dd-cb84-462b-a405-a5728d702647 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:12.441843 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2bde99dd-cb84-462b-a405-a5728d702647 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:12.459204 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a57ba12d-6bf4-4d7e-8556-04508f63ff8e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:12.466997 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a57ba12d-6bf4-4d7e-8556-04508f63ff8e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1219 microversion: 2.1 time: 0.086377 Jul 30 16:11:12.467497 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 337/662] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:12 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:12.472095 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a812447b-fd70-48a3-8627-64cb9b0c19bd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:12.473014 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a812447b-fd70-48a3-8627-64cb9b0c19bd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:12.478842 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a812447b-fd70-48a3-8627-64cb9b0c19bd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:12.479325 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a812447b-fd70-48a3-8627-64cb9b0c19bd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:12.480088 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a812447b-fd70-48a3-8627-64cb9b0c19bd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:12.480798 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a812447b-fd70-48a3-8627-64cb9b0c19bd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:12.582423 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-2bde99dd-cb84-462b-a405-a5728d702647 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:12.592860 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-2bde99dd-cb84-462b-a405-a5728d702647 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1508 microversion: 2.1 time: 0.164860 Jul 30 16:11:12.593797 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 326/663] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:12 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:12.598696 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9e82e789-41fa-4a0d-9fe6-64beef83d224 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:12.599737 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9e82e789-41fa-4a0d-9fe6-64beef83d224 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:12.605913 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9e82e789-41fa-4a0d-9fe6-64beef83d224 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:12.606744 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9e82e789-41fa-4a0d-9fe6-64beef83d224 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:12.607788 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9e82e789-41fa-4a0d-9fe6-64beef83d224 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:12.608405 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9e82e789-41fa-4a0d-9fe6-64beef83d224 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:12.620818 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a812447b-fd70-48a3-8627-64cb9b0c19bd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:12.630241 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a812447b-fd70-48a3-8627-64cb9b0c19bd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.161574 Jul 30 16:11:12.630895 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 338/664] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:12 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:12.736356 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9e82e789-41fa-4a0d-9fe6-64beef83d224 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:12.744018 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9e82e789-41fa-4a0d-9fe6-64beef83d224 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1514 microversion: 2.1 time: 0.148947 Jul 30 16:11:12.744584 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 327/665] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:12 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:13.259877 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-6659eef4-f9df-4609-95e0-9db8ce6e38fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:13.260482 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-6659eef4-f9df-4609-95e0-9db8ce6e38fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:13.267014 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6659eef4-f9df-4609-95e0-9db8ce6e38fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:13.267486 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6659eef4-f9df-4609-95e0-9db8ce6e38fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:13.268266 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6659eef4-f9df-4609-95e0-9db8ce6e38fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:13.268695 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6659eef4-f9df-4609-95e0-9db8ce6e38fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:13.483811 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-5b5555de-b48f-407b-85cf-ab37a5514599 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:13.484424 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-5b5555de-b48f-407b-85cf-ab37a5514599 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:13.490316 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5b5555de-b48f-407b-85cf-ab37a5514599 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:13.490763 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5b5555de-b48f-407b-85cf-ab37a5514599 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:13.491751 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5b5555de-b48f-407b-85cf-ab37a5514599 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:13.492185 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5b5555de-b48f-407b-85cf-ab37a5514599 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:13.553079 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-5b5555de-b48f-407b-85cf-ab37a5514599 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:13.560256 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-5b5555de-b48f-407b-85cf-ab37a5514599 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1271 microversion: 2.1 time: 0.080843 Jul 30 16:11:13.560822 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 328/666] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:13 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1271 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:13.577549 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6659eef4-f9df-4609-95e0-9db8ce6e38fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:13.585421 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6659eef4-f9df-4609-95e0-9db8ce6e38fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:13.587013 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6659eef4-f9df-4609-95e0-9db8ce6e38fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:13.588253 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-6659eef4-f9df-4609-95e0-9db8ce6e38fb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1720 microversion: 2.20 time: 0.332137 Jul 30 16:11:13.588906 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 339/667] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:13 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1720 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:13.609871 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a105d38a-bf1e-4d18-bd51-df5a316b4a16 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:13.610482 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a105d38a-bf1e-4d18-bd51-df5a316b4a16 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:13.616359 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a105d38a-bf1e-4d18-bd51-df5a316b4a16 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:13.616807 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a105d38a-bf1e-4d18-bd51-df5a316b4a16 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:13.617560 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a105d38a-bf1e-4d18-bd51-df5a316b4a16 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:13.617999 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a105d38a-bf1e-4d18-bd51-df5a316b4a16 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:13.647817 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0694bf5d-c858-4f41-b94d-624332c7a219 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:13.648432 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0694bf5d-c858-4f41-b94d-624332c7a219 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:13.655049 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0694bf5d-c858-4f41-b94d-624332c7a219 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:13.657260 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0694bf5d-c858-4f41-b94d-624332c7a219 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:13.658065 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0694bf5d-c858-4f41-b94d-624332c7a219 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:13.658510 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0694bf5d-c858-4f41-b94d-624332c7a219 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:13.764694 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-a105d38a-bf1e-4d18-bd51-df5a316b4a16 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:13.772616 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a105d38a-bf1e-4d18-bd51-df5a316b4a16 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1508 microversion: 2.1 time: 0.166782 Jul 30 16:11:13.782473 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 329/668] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:13 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:13.786768 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a1d6752c-da0d-413d-b9d6-db69be031701 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:13.786768 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a1d6752c-da0d-413d-b9d6-db69be031701 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:13.793311 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a1d6752c-da0d-413d-b9d6-db69be031701 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:13.793773 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a1d6752c-da0d-413d-b9d6-db69be031701 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:13.794848 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a1d6752c-da0d-413d-b9d6-db69be031701 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:13.795345 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a1d6752c-da0d-413d-b9d6-db69be031701 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:13.885391 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0694bf5d-c858-4f41-b94d-624332c7a219 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:13.894125 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0694bf5d-c858-4f41-b94d-624332c7a219 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.249823 Jul 30 16:11:13.894893 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 340/669] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:13 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:13.936842 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-a1d6752c-da0d-413d-b9d6-db69be031701 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:13.944636 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a1d6752c-da0d-413d-b9d6-db69be031701 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1514 microversion: 2.1 time: 0.170441 Jul 30 16:11:13.945208 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 330/670] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:13 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:14.577978 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-cb221b7e-97e7-4dd3-89f5-f4d26e5d8fd1 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:14.578865 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-cb221b7e-97e7-4dd3-89f5-f4d26e5d8fd1 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:14.585831 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cb221b7e-97e7-4dd3-89f5-f4d26e5d8fd1 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:14.586506 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cb221b7e-97e7-4dd3-89f5-f4d26e5d8fd1 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:14.587438 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cb221b7e-97e7-4dd3-89f5-f4d26e5d8fd1 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:14.587872 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cb221b7e-97e7-4dd3-89f5-f4d26e5d8fd1 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:14.608032 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f969a65c-d23a-410f-afff-45b5b2753fc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:14.609273 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f969a65c-d23a-410f-afff-45b5b2753fc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:14.615500 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f969a65c-d23a-410f-afff-45b5b2753fc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:14.616080 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f969a65c-d23a-410f-afff-45b5b2753fc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:14.616872 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f969a65c-d23a-410f-afff-45b5b2753fc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:14.617310 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f969a65c-d23a-410f-afff-45b5b2753fc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:14.750134 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f969a65c-d23a-410f-afff-45b5b2753fc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:14.757926 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f969a65c-d23a-410f-afff-45b5b2753fc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:14.759602 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f969a65c-d23a-410f-afff-45b5b2753fc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:14.760811 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f969a65c-d23a-410f-afff-45b5b2753fc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1720 microversion: 2.20 time: 0.157505 Jul 30 16:11:14.772161 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 331/671] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:14 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:14.789706 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-997dd002-0969-45a8-8bbb-21521bc102fd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:14.790845 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-997dd002-0969-45a8-8bbb-21521bc102fd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:14.799006 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-997dd002-0969-45a8-8bbb-21521bc102fd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:14.799507 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-997dd002-0969-45a8-8bbb-21521bc102fd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:14.800306 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-997dd002-0969-45a8-8bbb-21521bc102fd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:14.800713 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-997dd002-0969-45a8-8bbb-21521bc102fd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:14.873731 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-cb221b7e-97e7-4dd3-89f5-f4d26e5d8fd1 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:14.887940 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-cb221b7e-97e7-4dd3-89f5-f4d26e5d8fd1 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.312776 Jul 30 16:11:14.892178 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 341/672] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:14 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:14.913998 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-593edb00-7fb4-4be3-9932-39848c107fa9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:14.914679 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-593edb00-7fb4-4be3-9932-39848c107fa9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:14.922163 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-593edb00-7fb4-4be3-9932-39848c107fa9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:14.922632 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-593edb00-7fb4-4be3-9932-39848c107fa9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:14.923482 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-593edb00-7fb4-4be3-9932-39848c107fa9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:14.923960 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-593edb00-7fb4-4be3-9932-39848c107fa9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:14.981205 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-997dd002-0969-45a8-8bbb-21521bc102fd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:14.989585 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-997dd002-0969-45a8-8bbb-21521bc102fd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1508 microversion: 2.1 time: 0.203546 Jul 30 16:11:14.990163 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 332/673] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:14 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:14.996203 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-7b01c9db-cb73-441c-8d1f-6ceb7b4a7f6f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:14.996869 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7b01c9db-cb73-441c-8d1f-6ceb7b4a7f6f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:15.004067 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7b01c9db-cb73-441c-8d1f-6ceb7b4a7f6f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:15.005636 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7b01c9db-cb73-441c-8d1f-6ceb7b4a7f6f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:15.005636 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7b01c9db-cb73-441c-8d1f-6ceb7b4a7f6f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:15.005846 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7b01c9db-cb73-441c-8d1f-6ceb7b4a7f6f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:15.136559 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-593edb00-7fb4-4be3-9932-39848c107fa9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:15.142093 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-7b01c9db-cb73-441c-8d1f-6ceb7b4a7f6f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:15.150684 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-593edb00-7fb4-4be3-9932-39848c107fa9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1721 microversion: 2.1 time: 0.241040 Jul 30 16:11:15.151590 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 342/674] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:14 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1721 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:15.156769 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-7b01c9db-cb73-441c-8d1f-6ceb7b4a7f6f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1514 microversion: 2.1 time: 0.165576 Jul 30 16:11:15.157633 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 333/675] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:14 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:15.349838 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-ea5c5bdb-feab-450b-9ea7-e90f60d6f8b8 req-b99e2fa7-227d-432a-81be-f6b049f8a6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eefff8e4-fced-4b3a-8f42-a3555e17a203", "tag": "e2691890-7408-442b-9f7b-d4d100c13d23"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:11:15.351186 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:11:15.351186 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:11:15.359225 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-ea5c5bdb-feab-450b-9ea7-e90f60d6f8b8 req-b99e2fa7-227d-432a-81be-f6b049f8a6b7 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:15.359850 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-ea5c5bdb-feab-450b-9ea7-e90f60d6f8b8 req-b99e2fa7-227d-432a-81be-f6b049f8a6b7 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:15.370618 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-ea5c5bdb-feab-450b-9ea7-e90f60d6f8b8 req-b99e2fa7-227d-432a-81be-f6b049f8a6b7 service nova] Creating event network-changed:e2691890-7408-442b-9f7b-d4d100c13d23 for instance eefff8e4-fced-4b3a-8f42-a3555e17a203 on hv-cinder-80304 Jul 30 16:11:15.375407 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-ea5c5bdb-feab-450b-9ea7-e90f60d6f8b8 req-b99e2fa7-227d-432a-81be-f6b049f8a6b7 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029679 Jul 30 16:11:15.375859 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 343/676] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:11:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:11:15.778969 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ed28c113-d501-410b-a3b0-af37ecee2a5e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:15.779607 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ed28c113-d501-410b-a3b0-af37ecee2a5e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:15.785357 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ed28c113-d501-410b-a3b0-af37ecee2a5e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:15.785805 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ed28c113-d501-410b-a3b0-af37ecee2a5e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:15.786570 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ed28c113-d501-410b-a3b0-af37ecee2a5e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:15.787086 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ed28c113-d501-410b-a3b0-af37ecee2a5e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:15.908745 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-556197e6-50e6-4486-bbf7-df00765d393b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:15.909441 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-556197e6-50e6-4486-bbf7-df00765d393b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:15.910121 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-ed28c113-d501-410b-a3b0-af37ecee2a5e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:15.915551 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-556197e6-50e6-4486-bbf7-df00765d393b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:15.915997 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-556197e6-50e6-4486-bbf7-df00765d393b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:15.916768 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-556197e6-50e6-4486-bbf7-df00765d393b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:15.917196 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-556197e6-50e6-4486-bbf7-df00765d393b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:15.919491 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-ed28c113-d501-410b-a3b0-af37ecee2a5e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:15.921022 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-ed28c113-d501-410b-a3b0-af37ecee2a5e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:15.922167 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ed28c113-d501-410b-a3b0-af37ecee2a5e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1723 microversion: 2.20 time: 0.147149 Jul 30 16:11:15.922866 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 334/677] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:15 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:15.940494 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c4a8f866-bc01-4b25-bacd-ce5ffd93e2be tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef3cd35c-fbe1-48c5-aa51-f4d80f79a628"}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:11:15.943296 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c4a8f866-bc01-4b25-bacd-ce5ffd93e2be tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:15.949266 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c4a8f866-bc01-4b25-bacd-ce5ffd93e2be tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:15.952796 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c4a8f866-bc01-4b25-bacd-ce5ffd93e2be tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:15.953642 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c4a8f866-bc01-4b25-bacd-ce5ffd93e2be tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:15.954088 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c4a8f866-bc01-4b25-bacd-ce5ffd93e2be tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:16.123093 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-556197e6-50e6-4486-bbf7-df00765d393b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:16.131098 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-556197e6-50e6-4486-bbf7-df00765d393b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.226458 Jul 30 16:11:16.140881 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 344/678] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:15 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:16.140881 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4ecb3d5a-bf75-43da-9994-42ca92b568d8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:16.140881 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4ecb3d5a-bf75-43da-9994-42ca92b568d8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:16.144917 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4ecb3d5a-bf75-43da-9994-42ca92b568d8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:16.144917 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4ecb3d5a-bf75-43da-9994-42ca92b568d8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:16.145843 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4ecb3d5a-bf75-43da-9994-42ca92b568d8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:16.146232 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4ecb3d5a-bf75-43da-9994-42ca92b568d8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:16.239551 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c4a8f866-bc01-4b25-bacd-ce5ffd93e2be tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.302739 Jul 30 16:11:16.240160 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 335/679] 10.222.0.37 () {62 vars in 1364 bytes} [Fri Jul 30 16:11:15 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/os-volume_attachments => generated 188 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:11:16.244602 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-2a80a1c6-7464-4c93-a48b-b035acc1c010 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:16.246872 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-2a80a1c6-7464-4c93-a48b-b035acc1c010 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:16.253937 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2a80a1c6-7464-4c93-a48b-b035acc1c010 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:16.254448 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2a80a1c6-7464-4c93-a48b-b035acc1c010 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:16.255407 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2a80a1c6-7464-4c93-a48b-b035acc1c010 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:16.255850 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2a80a1c6-7464-4c93-a48b-b035acc1c010 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:16.359794 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4ecb3d5a-bf75-43da-9994-42ca92b568d8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:16.366659 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4ecb3d5a-bf75-43da-9994-42ca92b568d8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1508 microversion: 2.1 time: 0.233567 Jul 30 16:11:16.376716 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 345/680] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:16 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1508 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:16.376716 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d83fbeb5-4bb7-44a4-a8e7-72b894c855fb tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:16.376716 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d83fbeb5-4bb7-44a4-a8e7-72b894c855fb tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:16.378697 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d83fbeb5-4bb7-44a4-a8e7-72b894c855fb tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:16.379175 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d83fbeb5-4bb7-44a4-a8e7-72b894c855fb tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:16.379959 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d83fbeb5-4bb7-44a4-a8e7-72b894c855fb tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:16.380392 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d83fbeb5-4bb7-44a4-a8e7-72b894c855fb tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:16.403695 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-2a80a1c6-7464-4c93-a48b-b035acc1c010 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:16.411844 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-2a80a1c6-7464-4c93-a48b-b035acc1c010 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1514 microversion: 2.1 time: 0.170579 Jul 30 16:11:16.412471 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 336/681] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:16 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:16.427460 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e3f4fbc3-93e8-4f8f-889f-4cc79b338145 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:11:16.428021 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e3f4fbc3-93e8-4f8f-889f-4cc79b338145 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:16.433985 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e3f4fbc3-93e8-4f8f-889f-4cc79b338145 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:16.434479 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e3f4fbc3-93e8-4f8f-889f-4cc79b338145 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:16.435762 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e3f4fbc3-93e8-4f8f-889f-4cc79b338145 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:16.435762 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e3f4fbc3-93e8-4f8f-889f-4cc79b338145 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:16.516995 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e3f4fbc3-93e8-4f8f-889f-4cc79b338145 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action" status: 202 len: 0 microversion: 2.20 time: 0.093047 Jul 30 16:11:16.517900 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 337/682] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:11:16 2021] POST /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 16:11:16.525532 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d29886a3-5be1-4931-b092-af893c33f350 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:16.526266 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d29886a3-5be1-4931-b092-af893c33f350 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:16.532294 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d29886a3-5be1-4931-b092-af893c33f350 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:16.532733 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d29886a3-5be1-4931-b092-af893c33f350 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:16.533509 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d29886a3-5be1-4931-b092-af893c33f350 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:16.533949 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d29886a3-5be1-4931-b092-af893c33f350 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:16.634340 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d83fbeb5-4bb7-44a4-a8e7-72b894c855fb tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:16.645684 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d83fbeb5-4bb7-44a4-a8e7-72b894c855fb tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1698 microversion: 2.1 time: 0.277234 Jul 30 16:11:16.657265 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 346/683] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:16 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1698 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:16.664517 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-26991fce-009c-49b2-b630-cb87e11a89d2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:11:16.670340 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d29886a3-5be1-4931-b092-af893c33f350 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:16.672501 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-26991fce-009c-49b2-b630-cb87e11a89d2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:16.673039 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-26991fce-009c-49b2-b630-cb87e11a89d2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:16.679018 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d29886a3-5be1-4931-b092-af893c33f350 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:16.680635 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d29886a3-5be1-4931-b092-af893c33f350 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:16.681848 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d29886a3-5be1-4931-b092-af893c33f350 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1749 microversion: 2.20 time: 0.160055 Jul 30 16:11:16.682887 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 338/684] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:16 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:16.745721 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-26991fce-009c-49b2-b630-cb87e11a89d2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Going to try to start instance {{(pid=107453) start /opt/stack/nova/nova/compute/api.py:2603}} Jul 30 16:11:16.789130 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-26991fce-009c-49b2-b630-cb87e11a89d2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 202 len: 0 microversion: 2.1 time: 0.129042 Jul 30 16:11:16.790417 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 347/685] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:11:16 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:11:16.799378 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0a14dc42-5feb-4c8f-bafb-22ffff84a743 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:16.800075 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0a14dc42-5feb-4c8f-bafb-22ffff84a743 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:16.806358 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0a14dc42-5feb-4c8f-bafb-22ffff84a743 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:16.806809 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0a14dc42-5feb-4c8f-bafb-22ffff84a743 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:16.807609 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0a14dc42-5feb-4c8f-bafb-22ffff84a743 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:16.808052 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0a14dc42-5feb-4c8f-bafb-22ffff84a743 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:16.953446 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0a14dc42-5feb-4c8f-bafb-22ffff84a743 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:16.961788 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0a14dc42-5feb-4c8f-bafb-22ffff84a743 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1707 microversion: 2.1 time: 0.166502 Jul 30 16:11:16.962604 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 339/686] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:16 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1707 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:17.149138 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4f6058e9-de06-4774-97cc-a8229d7311f9 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:17.150000 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4f6058e9-de06-4774-97cc-a8229d7311f9 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:17.157966 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4f6058e9-de06-4774-97cc-a8229d7311f9 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:17.158483 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4f6058e9-de06-4774-97cc-a8229d7311f9 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:17.159420 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4f6058e9-de06-4774-97cc-a8229d7311f9 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:17.159968 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4f6058e9-de06-4774-97cc-a8229d7311f9 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:17.384798 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-aee7900c-91e2-4284-bd25-52f7cad7fc25 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:17.385629 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-aee7900c-91e2-4284-bd25-52f7cad7fc25 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:17.392204 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4f6058e9-de06-4774-97cc-a8229d7311f9 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:17.393526 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aee7900c-91e2-4284-bd25-52f7cad7fc25 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:17.393526 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aee7900c-91e2-4284-bd25-52f7cad7fc25 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:17.393911 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aee7900c-91e2-4284-bd25-52f7cad7fc25 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:17.394929 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aee7900c-91e2-4284-bd25-52f7cad7fc25 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:17.399705 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4f6058e9-de06-4774-97cc-a8229d7311f9 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.254974 Jul 30 16:11:17.400476 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 348/687] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:17 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:17.431584 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-fc3b22bf-f986-4a2d-877a-c8f8a58f3491 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:17.433428 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-fc3b22bf-f986-4a2d-877a-c8f8a58f3491 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:17.442528 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fc3b22bf-f986-4a2d-877a-c8f8a58f3491 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:17.443591 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fc3b22bf-f986-4a2d-877a-c8f8a58f3491 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:17.445346 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fc3b22bf-f986-4a2d-877a-c8f8a58f3491 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:17.446017 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fc3b22bf-f986-4a2d-877a-c8f8a58f3491 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:17.558957 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-fc3b22bf-f986-4a2d-877a-c8f8a58f3491 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:17.568422 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-fc3b22bf-f986-4a2d-877a-c8f8a58f3491 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1472 microversion: 2.1 time: 0.142911 Jul 30 16:11:17.568996 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 349/688] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:17 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1472 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:17.596220 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-f17529f5-b181-4431-a9e3-6d5495245056 req-c0140398-1608-467b-9888-1a0f6bdc018c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5d7bd6-b662-4643-9c1d-a765d1bee1fa", "name": "network-vif-deleted", "tag": "5cd5ad30-0cab-4585-9e7f-c3f967ec1d9f"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:11:17.597947 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:11:17.597947 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:11:17.610522 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-f17529f5-b181-4431-a9e3-6d5495245056 req-c0140398-1608-467b-9888-1a0f6bdc018c service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:17.611039 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-f17529f5-b181-4431-a9e3-6d5495245056 req-c0140398-1608-467b-9888-1a0f6bdc018c service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:17.623458 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-f17529f5-b181-4431-a9e3-6d5495245056 req-c0140398-1608-467b-9888-1a0f6bdc018c service nova] Creating event network-vif-deleted:5cd5ad30-0cab-4585-9e7f-c3f967ec1d9f for instance 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa on hv-cinder-80304 Jul 30 16:11:17.628567 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-f17529f5-b181-4431-a9e3-6d5495245056 req-c0140398-1608-467b-9888-1a0f6bdc018c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036005 Jul 30 16:11:17.629351 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 350/689] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:11:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:11:17.684239 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-aee7900c-91e2-4284-bd25-52f7cad7fc25 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:17.694623 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-aee7900c-91e2-4284-bd25-52f7cad7fc25 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1508 microversion: 2.1 time: 0.314200 Jul 30 16:11:17.702519 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-6523582d-2557-43b1-bc64-37dc33bd5db8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:17.703667 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-6523582d-2557-43b1-bc64-37dc33bd5db8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:17.706948 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 340/690] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:17 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1508 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:17.711385 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6523582d-2557-43b1-bc64-37dc33bd5db8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:17.712398 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6523582d-2557-43b1-bc64-37dc33bd5db8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:17.713211 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6523582d-2557-43b1-bc64-37dc33bd5db8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:17.713648 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6523582d-2557-43b1-bc64-37dc33bd5db8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:17.851515 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6523582d-2557-43b1-bc64-37dc33bd5db8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:17.861350 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6523582d-2557-43b1-bc64-37dc33bd5db8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:17.862984 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6523582d-2557-43b1-bc64-37dc33bd5db8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:17.864274 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-6523582d-2557-43b1-bc64-37dc33bd5db8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1751 microversion: 2.20 time: 0.167629 Jul 30 16:11:17.865212 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 351/691] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:17 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:11:17.978995 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8b16fcc0-cc7a-4d06-8767-12910ea27b48 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:17.979632 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8b16fcc0-cc7a-4d06-8767-12910ea27b48 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:17.986275 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8b16fcc0-cc7a-4d06-8767-12910ea27b48 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:17.986726 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8b16fcc0-cc7a-4d06-8767-12910ea27b48 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:17.987521 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8b16fcc0-cc7a-4d06-8767-12910ea27b48 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:17.987951 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8b16fcc0-cc7a-4d06-8767-12910ea27b48 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:18.109866 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8b16fcc0-cc7a-4d06-8767-12910ea27b48 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:18.117554 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8b16fcc0-cc7a-4d06-8767-12910ea27b48 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1707 microversion: 2.1 time: 0.142260 Jul 30 16:11:18.118112 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 341/692] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:17 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1707 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:18.416848 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f054a7dc-eb68-4e94-8b42-4af6a5286aed tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:18.417467 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f054a7dc-eb68-4e94-8b42-4af6a5286aed tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:18.424096 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f054a7dc-eb68-4e94-8b42-4af6a5286aed tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:18.424544 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f054a7dc-eb68-4e94-8b42-4af6a5286aed tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:18.425324 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f054a7dc-eb68-4e94-8b42-4af6a5286aed tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:18.425760 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f054a7dc-eb68-4e94-8b42-4af6a5286aed tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:18.556992 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f054a7dc-eb68-4e94-8b42-4af6a5286aed tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:18.565123 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f054a7dc-eb68-4e94-8b42-4af6a5286aed tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.151931 Jul 30 16:11:18.566075 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 352/693] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:18 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:18.586126 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9ff0062b-9422-48a1-b835-0ad6df618204 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:18.587164 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9ff0062b-9422-48a1-b835-0ad6df618204 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:18.594821 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9ff0062b-9422-48a1-b835-0ad6df618204 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:18.595456 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9ff0062b-9422-48a1-b835-0ad6df618204 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:18.596226 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9ff0062b-9422-48a1-b835-0ad6df618204 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:18.596657 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9ff0062b-9422-48a1-b835-0ad6df618204 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:18.631628 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9ff0062b-9422-48a1-b835-0ad6df618204 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:18.632168 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9ff0062b-9422-48a1-b835-0ad6df618204 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:18.632682 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.objects.instance [None req-9ff0062b-9422-48a1-b835-0ad6df618204 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lazy-loading 'fault' on Instance uuid 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa {{(pid=107452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:11:18.680128 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9ff0062b-9422-48a1-b835-0ad6df618204 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:18.692825 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9ff0062b-9422-48a1-b835-0ad6df618204 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 200 len: 1307 microversion: 2.1 time: 0.110942 Jul 30 16:11:18.693936 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 342/694] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:18 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 1307 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:18.712994 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d2f39562-3534-4306-8b13-73b5a1fd4f39 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:18.713618 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d2f39562-3534-4306-8b13-73b5a1fd4f39 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:18.720090 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d2f39562-3534-4306-8b13-73b5a1fd4f39 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:18.721338 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d2f39562-3534-4306-8b13-73b5a1fd4f39 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:18.722495 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d2f39562-3534-4306-8b13-73b5a1fd4f39 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:18.722942 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d2f39562-3534-4306-8b13-73b5a1fd4f39 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:18.855083 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d2f39562-3534-4306-8b13-73b5a1fd4f39 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:18.864510 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d2f39562-3534-4306-8b13-73b5a1fd4f39 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1508 microversion: 2.1 time: 0.155116 Jul 30 16:11:18.865301 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 353/695] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:18 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:18.883115 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-4b0b5d0d-77d8-4b27-a6be-a686e17d9867 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:18.883821 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-4b0b5d0d-77d8-4b27-a6be-a686e17d9867 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:18.891855 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4b0b5d0d-77d8-4b27-a6be-a686e17d9867 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:18.892316 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4b0b5d0d-77d8-4b27-a6be-a686e17d9867 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:18.893861 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4b0b5d0d-77d8-4b27-a6be-a686e17d9867 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:18.894311 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4b0b5d0d-77d8-4b27-a6be-a686e17d9867 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:19.094517 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-4b0b5d0d-77d8-4b27-a6be-a686e17d9867 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:19.103854 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-4b0b5d0d-77d8-4b27-a6be-a686e17d9867 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:19.105375 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-4b0b5d0d-77d8-4b27-a6be-a686e17d9867 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:19.107484 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-4b0b5d0d-77d8-4b27-a6be-a686e17d9867 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.227694 Jul 30 16:11:19.108033 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 343/696] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:18 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:11:19.133738 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-14236fab-80e6-4d25-9577-6fbcc4907d75 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:19.134361 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-14236fab-80e6-4d25-9577-6fbcc4907d75 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:19.140861 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-14236fab-80e6-4d25-9577-6fbcc4907d75 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:19.141794 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-14236fab-80e6-4d25-9577-6fbcc4907d75 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:19.142486 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-14236fab-80e6-4d25-9577-6fbcc4907d75 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:19.143094 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-14236fab-80e6-4d25-9577-6fbcc4907d75 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:19.259945 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-d87312e5-bb6f-4af4-af51-85aa55cb1a2e req-f0439da1-4e06-4f79-8aeb-9a02f84ba330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b40b08-b26d-408a-a189-89e1abad5e88", "name": "network-vif-deleted", "tag": "b7c2f2ac-ee9c-4c0b-9449-d350635bd2d0"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:11:19.261506 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:11:19.261506 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:11:19.273700 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-d87312e5-bb6f-4af4-af51-85aa55cb1a2e req-f0439da1-4e06-4f79-8aeb-9a02f84ba330 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:19.274148 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-d87312e5-bb6f-4af4-af51-85aa55cb1a2e req-f0439da1-4e06-4f79-8aeb-9a02f84ba330 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:19.277181 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-14236fab-80e6-4d25-9577-6fbcc4907d75 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:19.285073 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-14236fab-80e6-4d25-9577-6fbcc4907d75 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1711 microversion: 2.1 time: 0.155164 Jul 30 16:11:19.287181 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 354/697] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:19 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1711 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:19.289689 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-d87312e5-bb6f-4af4-af51-85aa55cb1a2e req-f0439da1-4e06-4f79-8aeb-9a02f84ba330 service nova] Creating event network-vif-deleted:b7c2f2ac-ee9c-4c0b-9449-d350635bd2d0 for instance 06b40b08-b26d-408a-a189-89e1abad5e88 on hv-cinder-80304 Jul 30 16:11:19.295606 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-d87312e5-bb6f-4af4-af51-85aa55cb1a2e req-f0439da1-4e06-4f79-8aeb-9a02f84ba330 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038880 Jul 30 16:11:19.296608 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 344/698] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:11:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:11:19.582385 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-50f108b1-57b3-453f-af59-832bbf3f7198 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:19.583149 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-50f108b1-57b3-453f-af59-832bbf3f7198 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:19.588860 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-50f108b1-57b3-453f-af59-832bbf3f7198 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:19.589319 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-50f108b1-57b3-453f-af59-832bbf3f7198 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:19.590074 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-50f108b1-57b3-453f-af59-832bbf3f7198 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:19.590511 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-50f108b1-57b3-453f-af59-832bbf3f7198 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:19.710469 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0273b164-17f7-4f1b-9da4-46e09a294e0e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:19.711235 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0273b164-17f7-4f1b-9da4-46e09a294e0e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:19.712664 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-50f108b1-57b3-453f-af59-832bbf3f7198 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:19.718493 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0273b164-17f7-4f1b-9da4-46e09a294e0e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:19.718947 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0273b164-17f7-4f1b-9da4-46e09a294e0e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:19.719757 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0273b164-17f7-4f1b-9da4-46e09a294e0e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:19.720193 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0273b164-17f7-4f1b-9da4-46e09a294e0e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:19.720578 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-50f108b1-57b3-453f-af59-832bbf3f7198 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.141913 Jul 30 16:11:19.721264 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 355/699] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:19 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:19.733548 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-0273b164-17f7-4f1b-9da4-46e09a294e0e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] HTTP exception thrown: Instance 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa could not be found. Jul 30 16:11:19.734127 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0273b164-17f7-4f1b-9da4-46e09a294e0e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Returning 404 to user: Instance 9c5d7bd6-b662-4643-9c1d-a765d1bee1fa could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:11:19.734951 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0273b164-17f7-4f1b-9da4-46e09a294e0e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa" status: 404 len: 111 microversion: 2.1 time: 0.028996 Jul 30 16:11:19.735532 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 345/700] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:19 2021] GET /compute/v2.1/servers/9c5d7bd6-b662-4643-9c1d-a765d1bee1fa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 16:11:19.881698 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d1617ab4-3612-43aa-bef0-45415a63a6de tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:19.882614 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d1617ab4-3612-43aa-bef0-45415a63a6de tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:19.888385 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d1617ab4-3612-43aa-bef0-45415a63a6de tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:19.888837 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d1617ab4-3612-43aa-bef0-45415a63a6de tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:19.889606 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d1617ab4-3612-43aa-bef0-45415a63a6de tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:19.890037 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d1617ab4-3612-43aa-bef0-45415a63a6de tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:19.935052 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d1617ab4-3612-43aa-bef0-45415a63a6de tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:19.935280 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d1617ab4-3612-43aa-bef0-45415a63a6de tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:19.935700 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.objects.instance [None req-d1617ab4-3612-43aa-bef0-45415a63a6de tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lazy-loading 'fault' on Instance uuid 06b40b08-b26d-408a-a189-89e1abad5e88 {{(pid=107453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:11:19.977537 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d1617ab4-3612-43aa-bef0-45415a63a6de tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:19.985081 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d1617ab4-3612-43aa-bef0-45415a63a6de tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 200 len: 1311 microversion: 2.1 time: 0.106966 Jul 30 16:11:19.985979 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 356/701] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:19 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:20.125609 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-834a3ad7-8db4-4c1f-a957-5d5e1fbbb688 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:20.126306 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-834a3ad7-8db4-4c1f-a957-5d5e1fbbb688 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:20.132292 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-834a3ad7-8db4-4c1f-a957-5d5e1fbbb688 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:20.132752 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-834a3ad7-8db4-4c1f-a957-5d5e1fbbb688 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:20.133531 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-834a3ad7-8db4-4c1f-a957-5d5e1fbbb688 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:20.133967 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-834a3ad7-8db4-4c1f-a957-5d5e1fbbb688 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:20.297767 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-834a3ad7-8db4-4c1f-a957-5d5e1fbbb688 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:20.306416 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-834a3ad7-8db4-4c1f-a957-5d5e1fbbb688 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:20.308121 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-834a3ad7-8db4-4c1f-a957-5d5e1fbbb688 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:20.309503 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-834a3ad7-8db4-4c1f-a957-5d5e1fbbb688 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.187626 Jul 30 16:11:20.310121 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 346/702] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:20 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:20.736844 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-787005e0-9dd7-4cdd-b0ad-f239d86ea3c1 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:20.738332 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-787005e0-9dd7-4cdd-b0ad-f239d86ea3c1 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:20.744933 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-787005e0-9dd7-4cdd-b0ad-f239d86ea3c1 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:20.745696 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-787005e0-9dd7-4cdd-b0ad-f239d86ea3c1 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:20.746685 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-787005e0-9dd7-4cdd-b0ad-f239d86ea3c1 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:20.747429 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-787005e0-9dd7-4cdd-b0ad-f239d86ea3c1 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:20.866824 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-be94b2d6-a440-40c0-bde6-a517697b34f9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:20.866824 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-be94b2d6-a440-40c0-bde6-a517697b34f9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:20.876412 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-be94b2d6-a440-40c0-bde6-a517697b34f9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:20.876871 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-be94b2d6-a440-40c0-bde6-a517697b34f9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:20.877665 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-be94b2d6-a440-40c0-bde6-a517697b34f9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:20.878103 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-be94b2d6-a440-40c0-bde6-a517697b34f9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:20.878208 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-787005e0-9dd7-4cdd-b0ad-f239d86ea3c1 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:20.886250 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-787005e0-9dd7-4cdd-b0ad-f239d86ea3c1 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.153077 Jul 30 16:11:20.887017 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 357/703] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:20 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:20.916857 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-be94b2d6-a440-40c0-bde6-a517697b34f9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Going to try to terminate instance {{(pid=107452) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:11:21.001858 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c7f04d70-f6d5-48f7-a6f9-f1e6402b121e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:21.002838 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c7f04d70-f6d5-48f7-a6f9-f1e6402b121e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: 06b40b08-b26d-408a-a189-89e1abad5e88] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:21.009221 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c7f04d70-f6d5-48f7-a6f9-f1e6402b121e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:21.010006 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c7f04d70-f6d5-48f7-a6f9-f1e6402b121e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:21.011111 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c7f04d70-f6d5-48f7-a6f9-f1e6402b121e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:21.011797 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c7f04d70-f6d5-48f7-a6f9-f1e6402b121e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:21.016766 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-be94b2d6-a440-40c0-bde6-a517697b34f9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "DELETE /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 204 len: 0 microversion: 2.1 time: 0.153450 Jul 30 16:11:21.017901 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 347/704] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:11:20 2021] DELETE /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 16:11:21.028346 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-237e1605-f241-4a91-8a66-5be5e32949e6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:21.028730 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-c7f04d70-f6d5-48f7-a6f9-f1e6402b121e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] HTTP exception thrown: Instance 06b40b08-b26d-408a-a189-89e1abad5e88 could not be found. Jul 30 16:11:21.029150 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-237e1605-f241-4a91-8a66-5be5e32949e6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:21.029295 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c7f04d70-f6d5-48f7-a6f9-f1e6402b121e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Returning 404 to user: Instance 06b40b08-b26d-408a-a189-89e1abad5e88 could not be found. {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:11:21.030211 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c7f04d70-f6d5-48f7-a6f9-f1e6402b121e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88" status: 404 len: 111 microversion: 2.1 time: 0.032055 Jul 30 16:11:21.030836 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 358/705] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:20 2021] GET /compute/v2.1/servers/06b40b08-b26d-408a-a189-89e1abad5e88 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 16:11:21.036987 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-237e1605-f241-4a91-8a66-5be5e32949e6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:21.037492 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-237e1605-f241-4a91-8a66-5be5e32949e6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:21.038335 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-237e1605-f241-4a91-8a66-5be5e32949e6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:21.038775 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-237e1605-f241-4a91-8a66-5be5e32949e6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:21.040479 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a5f56a4f-abac-4704-8345-994dfd40ec1a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:21.041220 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a5f56a4f-abac-4704-8345-994dfd40ec1a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:21.047830 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a5f56a4f-abac-4704-8345-994dfd40ec1a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:21.048308 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a5f56a4f-abac-4704-8345-994dfd40ec1a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:21.049100 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a5f56a4f-abac-4704-8345-994dfd40ec1a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:21.049541 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a5f56a4f-abac-4704-8345-994dfd40ec1a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:21.075656 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a5f56a4f-abac-4704-8345-994dfd40ec1a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Going to try to terminate instance {{(pid=107453) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:11:21.158252 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a5f56a4f-abac-4704-8345-994dfd40ec1a tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "DELETE /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 204 len: 0 microversion: 2.1 time: 0.122424 Jul 30 16:11:21.158829 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 359/706] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:11:21 2021] DELETE /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 16:11:21.167023 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9192ab00-98af-457f-b974-ac46128a8cf8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:21.167700 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9192ab00-98af-457f-b974-ac46128a8cf8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:21.173940 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9192ab00-98af-457f-b974-ac46128a8cf8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:21.174373 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9192ab00-98af-457f-b974-ac46128a8cf8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:21.175171 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9192ab00-98af-457f-b974-ac46128a8cf8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:21.175645 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9192ab00-98af-457f-b974-ac46128a8cf8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:21.183987 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-237e1605-f241-4a91-8a66-5be5e32949e6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:21.191600 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-237e1605-f241-4a91-8a66-5be5e32949e6 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.169134 Jul 30 16:11:21.192170 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 348/707] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:21 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:21.307000 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9192ab00-98af-457f-b974-ac46128a8cf8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:21.314982 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9192ab00-98af-457f-b974-ac46128a8cf8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.151954 Jul 30 16:11:21.315569 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 360/708] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:21 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:21.328683 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-76e3792f-666b-4dbb-b1fd-27c90a4bf30f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:21.329292 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-76e3792f-666b-4dbb-b1fd-27c90a4bf30f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:21.335201 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-76e3792f-666b-4dbb-b1fd-27c90a4bf30f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:21.335693 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-76e3792f-666b-4dbb-b1fd-27c90a4bf30f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:21.336552 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-76e3792f-666b-4dbb-b1fd-27c90a4bf30f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:21.336995 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-76e3792f-666b-4dbb-b1fd-27c90a4bf30f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:21.454807 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-76e3792f-666b-4dbb-b1fd-27c90a4bf30f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:21.463323 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-76e3792f-666b-4dbb-b1fd-27c90a4bf30f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:21.464728 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-76e3792f-666b-4dbb-b1fd-27c90a4bf30f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:21.466545 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-76e3792f-666b-4dbb-b1fd-27c90a4bf30f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.141190 Jul 30 16:11:21.467307 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 349/709] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:21 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:21.904505 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d1670413-c827-4ad0-ab89-c597310bcf2b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:21.905104 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d1670413-c827-4ad0-ab89-c597310bcf2b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:21.910911 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d1670413-c827-4ad0-ab89-c597310bcf2b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:21.911382 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d1670413-c827-4ad0-ab89-c597310bcf2b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:21.912141 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d1670413-c827-4ad0-ab89-c597310bcf2b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:21.912566 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d1670413-c827-4ad0-ab89-c597310bcf2b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:22.033400 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d1670413-c827-4ad0-ab89-c597310bcf2b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:22.040567 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d1670413-c827-4ad0-ab89-c597310bcf2b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.140506 Jul 30 16:11:22.041129 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 361/710] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:21 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:22.209528 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-79a23a88-82c2-4b05-9be7-a0181fbece44 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:22.210162 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-79a23a88-82c2-4b05-9be7-a0181fbece44 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:22.216907 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-79a23a88-82c2-4b05-9be7-a0181fbece44 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:22.217381 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-79a23a88-82c2-4b05-9be7-a0181fbece44 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:22.218189 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-79a23a88-82c2-4b05-9be7-a0181fbece44 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:22.218627 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-79a23a88-82c2-4b05-9be7-a0181fbece44 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:22.331925 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-eb781ed3-3f28-4aeb-af51-159ed262e549 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:22.332679 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-eb781ed3-3f28-4aeb-af51-159ed262e549 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:22.343624 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-eb781ed3-3f28-4aeb-af51-159ed262e549 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:22.344103 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-eb781ed3-3f28-4aeb-af51-159ed262e549 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:22.344826 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-eb781ed3-3f28-4aeb-af51-159ed262e549 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:22.345272 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-eb781ed3-3f28-4aeb-af51-159ed262e549 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:22.350320 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-79a23a88-82c2-4b05-9be7-a0181fbece44 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:22.358109 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-79a23a88-82c2-4b05-9be7-a0181fbece44 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.152444 Jul 30 16:11:22.358669 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 350/711] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:22 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:22.471831 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-eb781ed3-3f28-4aeb-af51-159ed262e549 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:22.479518 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-eb781ed3-3f28-4aeb-af51-159ed262e549 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.151271 Jul 30 16:11:22.480344 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 362/712] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:22 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:22.485565 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-57024b8b-49b8-4d76-9582-3532ca5379b9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:22.486265 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-57024b8b-49b8-4d76-9582-3532ca5379b9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:22.492020 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-57024b8b-49b8-4d76-9582-3532ca5379b9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:22.492460 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-57024b8b-49b8-4d76-9582-3532ca5379b9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:22.493208 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-57024b8b-49b8-4d76-9582-3532ca5379b9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:22.493633 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-57024b8b-49b8-4d76-9582-3532ca5379b9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:22.620534 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-57024b8b-49b8-4d76-9582-3532ca5379b9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:22.628937 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-57024b8b-49b8-4d76-9582-3532ca5379b9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:22.630430 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-57024b8b-49b8-4d76-9582-3532ca5379b9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:22.631605 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-57024b8b-49b8-4d76-9582-3532ca5379b9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.150306 Jul 30 16:11:22.632162 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 351/713] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:22 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:11:23.058092 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-60abe809-33e1-45ca-a300-f972fe38515c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:23.058539 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-60abe809-33e1-45ca-a300-f972fe38515c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:23.064702 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-60abe809-33e1-45ca-a300-f972fe38515c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:23.065149 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-60abe809-33e1-45ca-a300-f972fe38515c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:23.065914 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-60abe809-33e1-45ca-a300-f972fe38515c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:23.066341 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-60abe809-33e1-45ca-a300-f972fe38515c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:23.092180 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-b46360e8-cebf-4a48-9b3d-fd916184917d req-13fcc12e-051e-4b64-9a05-a27718ccadaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eefff8e4-fced-4b3a-8f42-a3555e17a203", "name": "network-vif-plugged", "status": "completed", "tag": "e2691890-7408-442b-9f7b-d4d100c13d23"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:11:23.093698 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:11:23.093698 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:11:23.100790 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-b46360e8-cebf-4a48-9b3d-fd916184917d req-13fcc12e-051e-4b64-9a05-a27718ccadaa service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:23.101230 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-b46360e8-cebf-4a48-9b3d-fd916184917d req-13fcc12e-051e-4b64-9a05-a27718ccadaa service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:23.113385 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-b46360e8-cebf-4a48-9b3d-fd916184917d req-13fcc12e-051e-4b64-9a05-a27718ccadaa service nova] Creating event network-vif-plugged:e2691890-7408-442b-9f7b-d4d100c13d23 for instance eefff8e4-fced-4b3a-8f42-a3555e17a203 on hv-cinder-80304 Jul 30 16:11:23.118119 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-b46360e8-cebf-4a48-9b3d-fd916184917d req-13fcc12e-051e-4b64-9a05-a27718ccadaa service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029936 Jul 30 16:11:23.118880 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 352/714] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:11:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:11:23.204752 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-60abe809-33e1-45ca-a300-f972fe38515c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:23.213546 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-60abe809-33e1-45ca-a300-f972fe38515c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.159227 Jul 30 16:11:23.217084 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 363/715] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:23 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:23.375039 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f267d3d5-9cb0-4237-8c68-fb198754041d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:23.375755 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f267d3d5-9cb0-4237-8c68-fb198754041d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:23.382327 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f267d3d5-9cb0-4237-8c68-fb198754041d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:23.382721 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f267d3d5-9cb0-4237-8c68-fb198754041d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:23.383525 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f267d3d5-9cb0-4237-8c68-fb198754041d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:23.383951 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f267d3d5-9cb0-4237-8c68-fb198754041d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:23.496788 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-6abd5b7e-12f8-4a92-87da-f399d35d0806 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:23.498019 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-6abd5b7e-12f8-4a92-87da-f399d35d0806 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:23.502837 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f267d3d5-9cb0-4237-8c68-fb198754041d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:23.504870 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6abd5b7e-12f8-4a92-87da-f399d35d0806 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:23.505433 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6abd5b7e-12f8-4a92-87da-f399d35d0806 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:23.506427 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6abd5b7e-12f8-4a92-87da-f399d35d0806 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:23.506967 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6abd5b7e-12f8-4a92-87da-f399d35d0806 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:23.510073 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f267d3d5-9cb0-4237-8c68-fb198754041d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.139756 Jul 30 16:11:23.510637 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 353/716] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:23 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:23.627223 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6abd5b7e-12f8-4a92-87da-f399d35d0806 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:23.634365 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-6abd5b7e-12f8-4a92-87da-f399d35d0806 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.141292 Jul 30 16:11:23.634921 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 364/717] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:23 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:23.649368 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b3a68ac0-3919-4dd6-aae4-1c13666a65d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:23.649968 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b3a68ac0-3919-4dd6-aae4-1c13666a65d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:23.655976 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b3a68ac0-3919-4dd6-aae4-1c13666a65d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:23.656421 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b3a68ac0-3919-4dd6-aae4-1c13666a65d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:23.657182 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b3a68ac0-3919-4dd6-aae4-1c13666a65d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:23.657616 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b3a68ac0-3919-4dd6-aae4-1c13666a65d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:23.783348 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b3a68ac0-3919-4dd6-aae4-1c13666a65d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:23.791417 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b3a68ac0-3919-4dd6-aae4-1c13666a65d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:23.792906 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b3a68ac0-3919-4dd6-aae4-1c13666a65d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:23.794618 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b3a68ac0-3919-4dd6-aae4-1c13666a65d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.148316 Jul 30 16:11:23.795188 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 354/718] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:23 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:24.231196 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-cfe61ac3-31ec-4018-b1b3-ee8d95e07356 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:24.232393 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-cfe61ac3-31ec-4018-b1b3-ee8d95e07356 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:24.238159 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cfe61ac3-31ec-4018-b1b3-ee8d95e07356 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:24.238602 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cfe61ac3-31ec-4018-b1b3-ee8d95e07356 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:24.239387 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cfe61ac3-31ec-4018-b1b3-ee8d95e07356 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:24.239815 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cfe61ac3-31ec-4018-b1b3-ee8d95e07356 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:24.359399 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-cfe61ac3-31ec-4018-b1b3-ee8d95e07356 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:24.369042 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-cfe61ac3-31ec-4018-b1b3-ee8d95e07356 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.141425 Jul 30 16:11:24.369921 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 365/719] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:24 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:24.528627 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-081bb4cd-767f-4696-9c94-0dca93de6099 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:24.529143 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-081bb4cd-767f-4696-9c94-0dca93de6099 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:24.535231 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-081bb4cd-767f-4696-9c94-0dca93de6099 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:24.535955 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-081bb4cd-767f-4696-9c94-0dca93de6099 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:24.536915 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-081bb4cd-767f-4696-9c94-0dca93de6099 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:24.537525 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-081bb4cd-767f-4696-9c94-0dca93de6099 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:24.651640 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b41641af-556e-46a1-9b2d-2139561ae13f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:24.652247 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b41641af-556e-46a1-9b2d-2139561ae13f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:24.658183 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b41641af-556e-46a1-9b2d-2139561ae13f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:24.658654 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b41641af-556e-46a1-9b2d-2139561ae13f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:24.659547 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b41641af-556e-46a1-9b2d-2139561ae13f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:24.659663 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-081bb4cd-767f-4696-9c94-0dca93de6099 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:24.659914 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b41641af-556e-46a1-9b2d-2139561ae13f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:24.666919 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-081bb4cd-767f-4696-9c94-0dca93de6099 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.142277 Jul 30 16:11:24.667526 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 355/720] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:24 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:24.788558 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b41641af-556e-46a1-9b2d-2139561ae13f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:24.796655 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b41641af-556e-46a1-9b2d-2139561ae13f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.148756 Jul 30 16:11:24.797212 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 366/721] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:24 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:24.812570 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-19bc6ff3-f503-4be9-9695-f52982f7ff18 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:24.813181 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-19bc6ff3-f503-4be9-9695-f52982f7ff18 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:24.818934 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-19bc6ff3-f503-4be9-9695-f52982f7ff18 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:24.819423 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-19bc6ff3-f503-4be9-9695-f52982f7ff18 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:24.820188 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-19bc6ff3-f503-4be9-9695-f52982f7ff18 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:24.820623 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-19bc6ff3-f503-4be9-9695-f52982f7ff18 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:24.944913 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-19bc6ff3-f503-4be9-9695-f52982f7ff18 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:24.953302 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-19bc6ff3-f503-4be9-9695-f52982f7ff18 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:24.955023 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-19bc6ff3-f503-4be9-9695-f52982f7ff18 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:24.957426 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-19bc6ff3-f503-4be9-9695-f52982f7ff18 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.148500 Jul 30 16:11:24.958033 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 356/722] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:24 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:11:25.386299 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f6bdd3a4-c7da-4e50-a306-015a839bb404 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:25.386896 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f6bdd3a4-c7da-4e50-a306-015a839bb404 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:25.393814 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f6bdd3a4-c7da-4e50-a306-015a839bb404 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:25.394265 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f6bdd3a4-c7da-4e50-a306-015a839bb404 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:25.395034 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f6bdd3a4-c7da-4e50-a306-015a839bb404 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:25.395497 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f6bdd3a4-c7da-4e50-a306-015a839bb404 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:25.517650 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f6bdd3a4-c7da-4e50-a306-015a839bb404 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:25.524922 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f6bdd3a4-c7da-4e50-a306-015a839bb404 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.142290 Jul 30 16:11:25.525486 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 367/723] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:25 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:25.684146 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-60a3b45e-4902-463a-abd2-b4ee287b3c98 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:25.685473 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-60a3b45e-4902-463a-abd2-b4ee287b3c98 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:25.692320 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-60a3b45e-4902-463a-abd2-b4ee287b3c98 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:25.693022 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-60a3b45e-4902-463a-abd2-b4ee287b3c98 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:25.693592 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-60a3b45e-4902-463a-abd2-b4ee287b3c98 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:25.694019 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-60a3b45e-4902-463a-abd2-b4ee287b3c98 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:25.815758 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9c45b92f-97a9-403a-84dc-ed1b53d4c6e5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:25.816402 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9c45b92f-97a9-403a-84dc-ed1b53d4c6e5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:25.828028 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9c45b92f-97a9-403a-84dc-ed1b53d4c6e5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:25.828472 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9c45b92f-97a9-403a-84dc-ed1b53d4c6e5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:25.829448 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9c45b92f-97a9-403a-84dc-ed1b53d4c6e5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:25.829890 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9c45b92f-97a9-403a-84dc-ed1b53d4c6e5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:25.849663 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-60a3b45e-4902-463a-abd2-b4ee287b3c98 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:25.857222 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-60a3b45e-4902-463a-abd2-b4ee287b3c98 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.176773 Jul 30 16:11:25.857826 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 357/724] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:25 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:25.952314 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9c45b92f-97a9-403a-84dc-ed1b53d4c6e5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:25.959932 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9c45b92f-97a9-403a-84dc-ed1b53d4c6e5 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.150281 Jul 30 16:11:25.960494 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 368/725] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:25 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:25.976183 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0ddd174d-512d-44c2-954b-2c410ff4956c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:25.976789 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0ddd174d-512d-44c2-954b-2c410ff4956c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:25.982756 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0ddd174d-512d-44c2-954b-2c410ff4956c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:25.983238 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0ddd174d-512d-44c2-954b-2c410ff4956c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:25.983997 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0ddd174d-512d-44c2-954b-2c410ff4956c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:25.984430 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0ddd174d-512d-44c2-954b-2c410ff4956c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:26.109387 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0ddd174d-512d-44c2-954b-2c410ff4956c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:26.117823 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0ddd174d-512d-44c2-954b-2c410ff4956c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:26.119429 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0ddd174d-512d-44c2-954b-2c410ff4956c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:26.120563 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0ddd174d-512d-44c2-954b-2c410ff4956c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.148213 Jul 30 16:11:26.121124 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 358/726] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:25 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:26.542100 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-07e25202-1d33-4e0e-91b2-6502e9abb175 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:26.542704 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-07e25202-1d33-4e0e-91b2-6502e9abb175 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:26.549042 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-07e25202-1d33-4e0e-91b2-6502e9abb175 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:26.549434 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-07e25202-1d33-4e0e-91b2-6502e9abb175 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:26.550214 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-07e25202-1d33-4e0e-91b2-6502e9abb175 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:26.550678 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-07e25202-1d33-4e0e-91b2-6502e9abb175 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:26.674043 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-07e25202-1d33-4e0e-91b2-6502e9abb175 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:26.681447 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-07e25202-1d33-4e0e-91b2-6502e9abb175 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.143013 Jul 30 16:11:26.682059 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 369/727] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:26 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:26.874334 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-001ece64-5965-4ff6-af6c-08db98006d7f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:26.874912 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-001ece64-5965-4ff6-af6c-08db98006d7f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:26.880742 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-001ece64-5965-4ff6-af6c-08db98006d7f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:26.881173 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-001ece64-5965-4ff6-af6c-08db98006d7f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:26.881934 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-001ece64-5965-4ff6-af6c-08db98006d7f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:26.882366 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-001ece64-5965-4ff6-af6c-08db98006d7f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:26.976936 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-bfc2047f-146a-4278-abe2-096b4f088a12 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:26.977551 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-bfc2047f-146a-4278-abe2-096b4f088a12 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:26.983339 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bfc2047f-146a-4278-abe2-096b4f088a12 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:26.983789 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bfc2047f-146a-4278-abe2-096b4f088a12 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:26.984561 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bfc2047f-146a-4278-abe2-096b4f088a12 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:26.984997 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bfc2047f-146a-4278-abe2-096b4f088a12 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:27.003970 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-001ece64-5965-4ff6-af6c-08db98006d7f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:27.011470 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-001ece64-5965-4ff6-af6c-08db98006d7f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.141363 Jul 30 16:11:27.022103 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 359/728] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:26 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:27.119651 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-bfc2047f-146a-4278-abe2-096b4f088a12 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:27.128227 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-bfc2047f-146a-4278-abe2-096b4f088a12 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.154733 Jul 30 16:11:27.139199 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 370/729] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:26 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:27.157717 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b90138be-6c44-477f-9f02-eea48356b3c4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:27.158322 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b90138be-6c44-477f-9f02-eea48356b3c4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:27.164507 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b90138be-6c44-477f-9f02-eea48356b3c4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:27.164939 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b90138be-6c44-477f-9f02-eea48356b3c4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:27.165873 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b90138be-6c44-477f-9f02-eea48356b3c4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:27.166149 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b90138be-6c44-477f-9f02-eea48356b3c4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:27.299985 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b90138be-6c44-477f-9f02-eea48356b3c4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:27.308376 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b90138be-6c44-477f-9f02-eea48356b3c4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:27.310655 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b90138be-6c44-477f-9f02-eea48356b3c4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:27.311825 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b90138be-6c44-477f-9f02-eea48356b3c4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.158553 Jul 30 16:11:27.312470 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 360/730] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:27 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:27.700077 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-925aebd8-680c-43b4-a552-4c1325cb2f81 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:27.700705 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-925aebd8-680c-43b4-a552-4c1325cb2f81 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:27.706626 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-925aebd8-680c-43b4-a552-4c1325cb2f81 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:27.707074 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-925aebd8-680c-43b4-a552-4c1325cb2f81 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:27.707893 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-925aebd8-680c-43b4-a552-4c1325cb2f81 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:27.708327 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-925aebd8-680c-43b4-a552-4c1325cb2f81 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:27.826547 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-925aebd8-680c-43b4-a552-4c1325cb2f81 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:27.833711 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-925aebd8-680c-43b4-a552-4c1325cb2f81 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.137601 Jul 30 16:11:27.834272 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 371/731] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:27 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:28.028354 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-83268804-a40c-45c8-871c-1a263e20cb33 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:28.029005 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-83268804-a40c-45c8-871c-1a263e20cb33 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:28.035382 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-83268804-a40c-45c8-871c-1a263e20cb33 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:28.035835 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-83268804-a40c-45c8-871c-1a263e20cb33 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:28.036604 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-83268804-a40c-45c8-871c-1a263e20cb33 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:28.037046 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-83268804-a40c-45c8-871c-1a263e20cb33 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:28.148471 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-cccbdc7b-7d90-4be8-abcd-0fb2f645c783 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:28.149068 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-cccbdc7b-7d90-4be8-abcd-0fb2f645c783 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:28.155215 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cccbdc7b-7d90-4be8-abcd-0fb2f645c783 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:28.155617 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cccbdc7b-7d90-4be8-abcd-0fb2f645c783 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:28.156453 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cccbdc7b-7d90-4be8-abcd-0fb2f645c783 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:28.166343 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-83268804-a40c-45c8-871c-1a263e20cb33 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:28.167758 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cccbdc7b-7d90-4be8-abcd-0fb2f645c783 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:28.174620 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-83268804-a40c-45c8-871c-1a263e20cb33 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.149930 Jul 30 16:11:28.175538 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 361/732] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:28 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:28.296106 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-cccbdc7b-7d90-4be8-abcd-0fb2f645c783 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:28.303501 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-cccbdc7b-7d90-4be8-abcd-0fb2f645c783 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.158694 Jul 30 16:11:28.304057 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 372/733] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:28 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:28.330223 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9617bcc3-a3b5-42b5-972d-2e18a6fc4960 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:28.331173 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9617bcc3-a3b5-42b5-972d-2e18a6fc4960 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:28.337564 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9617bcc3-a3b5-42b5-972d-2e18a6fc4960 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:28.338100 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9617bcc3-a3b5-42b5-972d-2e18a6fc4960 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:28.338950 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9617bcc3-a3b5-42b5-972d-2e18a6fc4960 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:28.339479 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9617bcc3-a3b5-42b5-972d-2e18a6fc4960 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:28.458703 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9617bcc3-a3b5-42b5-972d-2e18a6fc4960 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:28.467392 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9617bcc3-a3b5-42b5-972d-2e18a6fc4960 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:28.468881 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9617bcc3-a3b5-42b5-972d-2e18a6fc4960 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:28.470065 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9617bcc3-a3b5-42b5-972d-2e18a6fc4960 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.143703 Jul 30 16:11:28.470618 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 362/734] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:28 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:11:28.850886 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9a7785f1-47bd-4e29-a679-002ee121ccbf tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:28.851598 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9a7785f1-47bd-4e29-a679-002ee121ccbf tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:28.858432 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9a7785f1-47bd-4e29-a679-002ee121ccbf tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:28.858885 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9a7785f1-47bd-4e29-a679-002ee121ccbf tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:28.859684 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9a7785f1-47bd-4e29-a679-002ee121ccbf tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:28.860138 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9a7785f1-47bd-4e29-a679-002ee121ccbf tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:28.984326 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9a7785f1-47bd-4e29-a679-002ee121ccbf tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:28.991746 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9a7785f1-47bd-4e29-a679-002ee121ccbf tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.144577 Jul 30 16:11:28.992318 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 373/735] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:28 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:29.191678 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ccf67859-5968-448a-a613-20927acce725 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:29.192344 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ccf67859-5968-448a-a613-20927acce725 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:29.198272 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ccf67859-5968-448a-a613-20927acce725 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:29.198741 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ccf67859-5968-448a-a613-20927acce725 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:29.199580 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ccf67859-5968-448a-a613-20927acce725 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:29.200134 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ccf67859-5968-448a-a613-20927acce725 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:29.321411 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-32e31531-1690-4675-97f3-b0e6724758c7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:29.322034 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-32e31531-1690-4675-97f3-b0e6724758c7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:29.328018 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-32e31531-1690-4675-97f3-b0e6724758c7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:29.328463 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-32e31531-1690-4675-97f3-b0e6724758c7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:29.329227 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-32e31531-1690-4675-97f3-b0e6724758c7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:29.329660 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-32e31531-1690-4675-97f3-b0e6724758c7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:29.333000 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-ccf67859-5968-448a-a613-20927acce725 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:29.340197 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ccf67859-5968-448a-a613-20927acce725 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.152401 Jul 30 16:11:29.341468 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 363/736] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:29 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:29.452261 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-32e31531-1690-4675-97f3-b0e6724758c7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:29.459618 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-32e31531-1690-4675-97f3-b0e6724758c7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.141857 Jul 30 16:11:29.460185 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 374/737] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:29 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:29.488119 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-355a465f-38bd-4345-9106-9533c5de581c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:29.488725 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-355a465f-38bd-4345-9106-9533c5de581c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:29.494436 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-355a465f-38bd-4345-9106-9533c5de581c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:29.494879 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-355a465f-38bd-4345-9106-9533c5de581c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:29.495679 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-355a465f-38bd-4345-9106-9533c5de581c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:29.496107 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-355a465f-38bd-4345-9106-9533c5de581c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:29.626044 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-355a465f-38bd-4345-9106-9533c5de581c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:29.634224 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-355a465f-38bd-4345-9106-9533c5de581c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:29.635743 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-355a465f-38bd-4345-9106-9533c5de581c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:29.636875 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-355a465f-38bd-4345-9106-9533c5de581c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.152475 Jul 30 16:11:29.637486 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 364/738] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:29 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:30.009194 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2f85e54c-8bfa-441f-ac19-e3178a61600f tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:30.009909 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-2f85e54c-8bfa-441f-ac19-e3178a61600f tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:30.016246 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2f85e54c-8bfa-441f-ac19-e3178a61600f tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:30.017010 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2f85e54c-8bfa-441f-ac19-e3178a61600f tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:30.017836 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2f85e54c-8bfa-441f-ac19-e3178a61600f tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:30.018297 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2f85e54c-8bfa-441f-ac19-e3178a61600f tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:30.147323 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-2f85e54c-8bfa-441f-ac19-e3178a61600f tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:30.155026 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2f85e54c-8bfa-441f-ac19-e3178a61600f tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.149649 Jul 30 16:11:30.155611 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 375/739] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:30 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:30.357333 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c1b19f7f-0390-49c8-90e0-c056191c8f8e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:30.357944 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c1b19f7f-0390-49c8-90e0-c056191c8f8e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:30.363942 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c1b19f7f-0390-49c8-90e0-c056191c8f8e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:30.364391 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c1b19f7f-0390-49c8-90e0-c056191c8f8e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:30.365159 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c1b19f7f-0390-49c8-90e0-c056191c8f8e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:30.365597 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c1b19f7f-0390-49c8-90e0-c056191c8f8e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:30.476888 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b5fea7e3-7b6b-468c-a18e-a057d28005cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:30.477507 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b5fea7e3-7b6b-468c-a18e-a057d28005cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:30.483218 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b5fea7e3-7b6b-468c-a18e-a057d28005cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:30.483679 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b5fea7e3-7b6b-468c-a18e-a057d28005cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:30.484462 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b5fea7e3-7b6b-468c-a18e-a057d28005cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:30.484901 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b5fea7e3-7b6b-468c-a18e-a057d28005cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:30.489100 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c1b19f7f-0390-49c8-90e0-c056191c8f8e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:30.496310 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c1b19f7f-0390-49c8-90e0-c056191c8f8e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.143309 Jul 30 16:11:30.496966 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 365/740] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:30 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:30.613659 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b5fea7e3-7b6b-468c-a18e-a057d28005cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:30.620960 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b5fea7e3-7b6b-468c-a18e-a057d28005cf tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.147750 Jul 30 16:11:30.621519 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 376/741] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:30 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:30.656034 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-86bd4688-677f-4891-a327-b5cac8c30a17 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:30.656641 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-86bd4688-677f-4891-a327-b5cac8c30a17 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:30.662640 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-86bd4688-677f-4891-a327-b5cac8c30a17 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:30.663101 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-86bd4688-677f-4891-a327-b5cac8c30a17 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:30.663914 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-86bd4688-677f-4891-a327-b5cac8c30a17 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:30.664350 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-86bd4688-677f-4891-a327-b5cac8c30a17 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:30.789748 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-86bd4688-677f-4891-a327-b5cac8c30a17 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:30.799481 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-86bd4688-677f-4891-a327-b5cac8c30a17 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:30.800982 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-86bd4688-677f-4891-a327-b5cac8c30a17 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:30.802386 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-86bd4688-677f-4891-a327-b5cac8c30a17 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.150606 Jul 30 16:11:30.803299 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 366/742] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:30 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:31.172389 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ef182f5c-8a48-4cd3-9fbf-e5be66d6763a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:31.173039 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ef182f5c-8a48-4cd3-9fbf-e5be66d6763a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:31.178890 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ef182f5c-8a48-4cd3-9fbf-e5be66d6763a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:31.179386 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ef182f5c-8a48-4cd3-9fbf-e5be66d6763a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:31.180159 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ef182f5c-8a48-4cd3-9fbf-e5be66d6763a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:31.180599 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ef182f5c-8a48-4cd3-9fbf-e5be66d6763a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:31.313595 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ef182f5c-8a48-4cd3-9fbf-e5be66d6763a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:31.320831 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ef182f5c-8a48-4cd3-9fbf-e5be66d6763a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.152770 Jul 30 16:11:31.321387 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 377/743] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:31 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:31.513306 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-abae45f7-9f4d-4e01-b10d-05f72ee87801 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:31.513913 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-abae45f7-9f4d-4e01-b10d-05f72ee87801 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:31.520014 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-abae45f7-9f4d-4e01-b10d-05f72ee87801 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:31.520458 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-abae45f7-9f4d-4e01-b10d-05f72ee87801 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:31.521222 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-abae45f7-9f4d-4e01-b10d-05f72ee87801 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:31.521652 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-abae45f7-9f4d-4e01-b10d-05f72ee87801 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:31.637373 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9a83e4a4-1eb8-4079-8c66-85b42b8fdd0d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:31.638273 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9a83e4a4-1eb8-4079-8c66-85b42b8fdd0d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:31.643003 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-abae45f7-9f4d-4e01-b10d-05f72ee87801 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:31.650565 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9a83e4a4-1eb8-4079-8c66-85b42b8fdd0d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:31.651025 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9a83e4a4-1eb8-4079-8c66-85b42b8fdd0d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:31.651844 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9a83e4a4-1eb8-4079-8c66-85b42b8fdd0d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:31.652703 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9a83e4a4-1eb8-4079-8c66-85b42b8fdd0d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:31.661384 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-abae45f7-9f4d-4e01-b10d-05f72ee87801 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.152033 Jul 30 16:11:31.662188 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 367/744] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:31 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:31.805963 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9a83e4a4-1eb8-4079-8c66-85b42b8fdd0d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:31.813680 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9a83e4a4-1eb8-4079-8c66-85b42b8fdd0d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.180012 Jul 30 16:11:31.814240 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 378/745] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:31 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:31.821256 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-49f700e8-ecd2-4443-9697-951aabddfb4d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:31.821866 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-49f700e8-ecd2-4443-9697-951aabddfb4d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:31.827897 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-49f700e8-ecd2-4443-9697-951aabddfb4d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:31.828349 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-49f700e8-ecd2-4443-9697-951aabddfb4d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:31.829118 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-49f700e8-ecd2-4443-9697-951aabddfb4d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:31.829553 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-49f700e8-ecd2-4443-9697-951aabddfb4d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:31.955427 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-49f700e8-ecd2-4443-9697-951aabddfb4d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:31.964410 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-49f700e8-ecd2-4443-9697-951aabddfb4d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:31.966551 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-49f700e8-ecd2-4443-9697-951aabddfb4d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:31.967769 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-49f700e8-ecd2-4443-9697-951aabddfb4d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.150164 Jul 30 16:11:31.968326 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 368/746] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:31 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:32.337395 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-96c1690f-b16a-4d6d-8abb-9cdc66b46b49 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:32.338005 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-96c1690f-b16a-4d6d-8abb-9cdc66b46b49 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:32.343978 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-96c1690f-b16a-4d6d-8abb-9cdc66b46b49 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:32.344425 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-96c1690f-b16a-4d6d-8abb-9cdc66b46b49 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:32.345213 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-96c1690f-b16a-4d6d-8abb-9cdc66b46b49 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:32.346274 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-96c1690f-b16a-4d6d-8abb-9cdc66b46b49 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:32.474031 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-96c1690f-b16a-4d6d-8abb-9cdc66b46b49 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:32.482036 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-96c1690f-b16a-4d6d-8abb-9cdc66b46b49 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.148221 Jul 30 16:11:32.482869 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 379/747] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:32 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:32.678692 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-aa0c568c-aa6f-4840-9583-64edc284f6c9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:32.679321 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-aa0c568c-aa6f-4840-9583-64edc284f6c9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:32.686511 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aa0c568c-aa6f-4840-9583-64edc284f6c9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:32.687106 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aa0c568c-aa6f-4840-9583-64edc284f6c9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:32.687935 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aa0c568c-aa6f-4840-9583-64edc284f6c9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:32.688401 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aa0c568c-aa6f-4840-9583-64edc284f6c9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:32.816641 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-aa0c568c-aa6f-4840-9583-64edc284f6c9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:32.830268 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-72df8009-1429-4a82-abbd-876f67d92ddc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:32.831124 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-72df8009-1429-4a82-abbd-876f67d92ddc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:32.835146 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-aa0c568c-aa6f-4840-9583-64edc284f6c9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.160056 Jul 30 16:11:32.835816 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 369/748] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:32 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:32.843248 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-72df8009-1429-4a82-abbd-876f67d92ddc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:32.843248 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-72df8009-1429-4a82-abbd-876f67d92ddc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:32.843248 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-72df8009-1429-4a82-abbd-876f67d92ddc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:32.843248 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-72df8009-1429-4a82-abbd-876f67d92ddc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:32.966394 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-72df8009-1429-4a82-abbd-876f67d92ddc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:32.973689 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-72df8009-1429-4a82-abbd-876f67d92ddc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.147686 Jul 30 16:11:32.974251 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 380/749] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:32 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:32.985915 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3f0a8187-23c1-4e1e-894e-7f5054584a8f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:32.986528 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3f0a8187-23c1-4e1e-894e-7f5054584a8f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:32.992374 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3f0a8187-23c1-4e1e-894e-7f5054584a8f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:32.992826 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3f0a8187-23c1-4e1e-894e-7f5054584a8f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:32.993593 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3f0a8187-23c1-4e1e-894e-7f5054584a8f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:32.994029 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3f0a8187-23c1-4e1e-894e-7f5054584a8f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:33.130604 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-3f0a8187-23c1-4e1e-894e-7f5054584a8f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:33.139706 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-3f0a8187-23c1-4e1e-894e-7f5054584a8f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:33.141260 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-3f0a8187-23c1-4e1e-894e-7f5054584a8f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:33.142675 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3f0a8187-23c1-4e1e-894e-7f5054584a8f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.160436 Jul 30 16:11:33.143742 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 370/750] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:32 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:33.499378 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4348bbe1-50f1-467b-ae55-03e1bacfb4c3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:33.500059 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4348bbe1-50f1-467b-ae55-03e1bacfb4c3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:33.506451 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4348bbe1-50f1-467b-ae55-03e1bacfb4c3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:33.506909 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4348bbe1-50f1-467b-ae55-03e1bacfb4c3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:33.507807 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4348bbe1-50f1-467b-ae55-03e1bacfb4c3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:33.508249 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4348bbe1-50f1-467b-ae55-03e1bacfb4c3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:33.634743 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4348bbe1-50f1-467b-ae55-03e1bacfb4c3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:33.643177 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4348bbe1-50f1-467b-ae55-03e1bacfb4c3 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.148177 Jul 30 16:11:33.644103 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 381/751] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:33 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:33.852463 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6258a783-d184-4d7d-a0ef-433eba75000a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:33.853038 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6258a783-d184-4d7d-a0ef-433eba75000a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:33.859334 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6258a783-d184-4d7d-a0ef-433eba75000a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:33.859787 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6258a783-d184-4d7d-a0ef-433eba75000a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:33.860562 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6258a783-d184-4d7d-a0ef-433eba75000a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:33.860998 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6258a783-d184-4d7d-a0ef-433eba75000a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:33.980440 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6258a783-d184-4d7d-a0ef-433eba75000a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:33.988120 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6258a783-d184-4d7d-a0ef-433eba75000a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.139345 Jul 30 16:11:33.988920 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 371/752] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:33 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:33.990002 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-dfb03476-3378-485f-b19a-d6627ac16dcb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:33.990613 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-dfb03476-3378-485f-b19a-d6627ac16dcb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:33.996555 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-dfb03476-3378-485f-b19a-d6627ac16dcb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:33.997541 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-dfb03476-3378-485f-b19a-d6627ac16dcb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:33.998452 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-dfb03476-3378-485f-b19a-d6627ac16dcb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:33.998895 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-dfb03476-3378-485f-b19a-d6627ac16dcb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:34.127331 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-dfb03476-3378-485f-b19a-d6627ac16dcb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:34.142443 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-dfb03476-3378-485f-b19a-d6627ac16dcb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.156031 Jul 30 16:11:34.143053 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 382/753] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:33 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:34.161304 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-008cdeda-b9ff-4e6f-966b-e5aa15d41894 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:34.161994 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-008cdeda-b9ff-4e6f-966b-e5aa15d41894 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:34.168292 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-008cdeda-b9ff-4e6f-966b-e5aa15d41894 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:34.169302 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-008cdeda-b9ff-4e6f-966b-e5aa15d41894 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:34.170355 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-008cdeda-b9ff-4e6f-966b-e5aa15d41894 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:34.170869 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-008cdeda-b9ff-4e6f-966b-e5aa15d41894 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:34.299220 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-008cdeda-b9ff-4e6f-966b-e5aa15d41894 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:34.308389 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-008cdeda-b9ff-4e6f-966b-e5aa15d41894 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:34.310410 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-008cdeda-b9ff-4e6f-966b-e5aa15d41894 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:34.311604 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-008cdeda-b9ff-4e6f-966b-e5aa15d41894 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.154025 Jul 30 16:11:34.312349 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 372/754] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:34 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:34.660098 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a13b295d-0eb4-4a7c-8cdb-46cec1965a57 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:34.660710 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a13b295d-0eb4-4a7c-8cdb-46cec1965a57 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:34.666846 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a13b295d-0eb4-4a7c-8cdb-46cec1965a57 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:34.667369 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a13b295d-0eb4-4a7c-8cdb-46cec1965a57 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:34.668163 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a13b295d-0eb4-4a7c-8cdb-46cec1965a57 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:34.668644 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a13b295d-0eb4-4a7c-8cdb-46cec1965a57 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:34.788202 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a13b295d-0eb4-4a7c-8cdb-46cec1965a57 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:34.796647 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a13b295d-0eb4-4a7c-8cdb-46cec1965a57 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.140139 Jul 30 16:11:34.797412 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 383/755] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:34 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:35.005456 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-aba45ca5-06b5-45a4-8409-90880eb76475 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:35.006054 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-aba45ca5-06b5-45a4-8409-90880eb76475 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:35.012091 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aba45ca5-06b5-45a4-8409-90880eb76475 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:35.013075 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aba45ca5-06b5-45a4-8409-90880eb76475 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:35.013871 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aba45ca5-06b5-45a4-8409-90880eb76475 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:35.014306 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aba45ca5-06b5-45a4-8409-90880eb76475 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:35.136534 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-aba45ca5-06b5-45a4-8409-90880eb76475 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:35.145287 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-aba45ca5-06b5-45a4-8409-90880eb76475 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.143505 Jul 30 16:11:35.145894 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 373/756] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:35 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:35.159366 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2015b4b0-a399-424f-bfa7-3d8e4f38e6f1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:35.160005 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-2015b4b0-a399-424f-bfa7-3d8e4f38e6f1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:35.165887 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2015b4b0-a399-424f-bfa7-3d8e4f38e6f1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:35.166341 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2015b4b0-a399-424f-bfa7-3d8e4f38e6f1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:35.167223 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2015b4b0-a399-424f-bfa7-3d8e4f38e6f1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:35.167654 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2015b4b0-a399-424f-bfa7-3d8e4f38e6f1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:35.304768 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-2015b4b0-a399-424f-bfa7-3d8e4f38e6f1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:35.312658 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2015b4b0-a399-424f-bfa7-3d8e4f38e6f1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.156846 Jul 30 16:11:35.313216 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 384/757] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:35 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:35.330666 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0412dc8a-9d48-4d83-b7ac-52f7fcbc1373 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:35.331323 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0412dc8a-9d48-4d83-b7ac-52f7fcbc1373 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:35.337339 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0412dc8a-9d48-4d83-b7ac-52f7fcbc1373 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:35.337788 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0412dc8a-9d48-4d83-b7ac-52f7fcbc1373 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:35.338559 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0412dc8a-9d48-4d83-b7ac-52f7fcbc1373 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:35.338998 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0412dc8a-9d48-4d83-b7ac-52f7fcbc1373 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:35.471465 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0412dc8a-9d48-4d83-b7ac-52f7fcbc1373 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:35.482861 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0412dc8a-9d48-4d83-b7ac-52f7fcbc1373 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:35.484835 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0412dc8a-9d48-4d83-b7ac-52f7fcbc1373 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:35.486187 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0412dc8a-9d48-4d83-b7ac-52f7fcbc1373 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.159690 Jul 30 16:11:35.495484 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 374/758] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:35 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:35.813985 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-25069a76-bf88-4fc5-9b99-0bd7756eeb08 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:35.814635 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-25069a76-bf88-4fc5-9b99-0bd7756eeb08 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:35.820567 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-25069a76-bf88-4fc5-9b99-0bd7756eeb08 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:35.821025 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-25069a76-bf88-4fc5-9b99-0bd7756eeb08 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:35.821790 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-25069a76-bf88-4fc5-9b99-0bd7756eeb08 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:35.822227 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-25069a76-bf88-4fc5-9b99-0bd7756eeb08 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:35.944786 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-25069a76-bf88-4fc5-9b99-0bd7756eeb08 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:35.952760 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-25069a76-bf88-4fc5-9b99-0bd7756eeb08 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.143223 Jul 30 16:11:35.953359 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 385/759] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:35 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:36.162895 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0e6c4aa8-d6ea-4fa1-a36a-c252a2e68b96 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:36.163788 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0e6c4aa8-d6ea-4fa1-a36a-c252a2e68b96 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:36.170166 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0e6c4aa8-d6ea-4fa1-a36a-c252a2e68b96 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:36.170614 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0e6c4aa8-d6ea-4fa1-a36a-c252a2e68b96 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:36.171457 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0e6c4aa8-d6ea-4fa1-a36a-c252a2e68b96 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:36.171886 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0e6c4aa8-d6ea-4fa1-a36a-c252a2e68b96 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:36.293709 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0e6c4aa8-d6ea-4fa1-a36a-c252a2e68b96 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:36.301145 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0e6c4aa8-d6ea-4fa1-a36a-c252a2e68b96 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.142865 Jul 30 16:11:36.301928 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 375/760] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:36 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:36.329976 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d7df58c1-a6a9-4b05-b31b-57285b6706f7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:36.330575 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d7df58c1-a6a9-4b05-b31b-57285b6706f7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:36.336455 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d7df58c1-a6a9-4b05-b31b-57285b6706f7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:36.336894 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d7df58c1-a6a9-4b05-b31b-57285b6706f7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:36.337651 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d7df58c1-a6a9-4b05-b31b-57285b6706f7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:36.338078 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d7df58c1-a6a9-4b05-b31b-57285b6706f7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:36.459770 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d7df58c1-a6a9-4b05-b31b-57285b6706f7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:36.467101 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d7df58c1-a6a9-4b05-b31b-57285b6706f7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.140844 Jul 30 16:11:36.467678 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 386/761] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:36 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:36.506368 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-97d065f6-7eb0-49c3-9bfa-43bf6cc636d0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:36.506982 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-97d065f6-7eb0-49c3-9bfa-43bf6cc636d0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:36.513548 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-97d065f6-7eb0-49c3-9bfa-43bf6cc636d0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:36.513989 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-97d065f6-7eb0-49c3-9bfa-43bf6cc636d0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:36.514771 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-97d065f6-7eb0-49c3-9bfa-43bf6cc636d0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:36.515231 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-97d065f6-7eb0-49c3-9bfa-43bf6cc636d0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:36.633563 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-97d065f6-7eb0-49c3-9bfa-43bf6cc636d0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:36.642217 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-97d065f6-7eb0-49c3-9bfa-43bf6cc636d0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:36.643760 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-97d065f6-7eb0-49c3-9bfa-43bf6cc636d0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:36.644891 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-97d065f6-7eb0-49c3-9bfa-43bf6cc636d0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.142789 Jul 30 16:11:36.645451 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 376/762] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:36 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:36.970383 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8abaa1ed-98d3-4229-a075-107582dc2838 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:36.971082 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-8abaa1ed-98d3-4229-a075-107582dc2838 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:36.976884 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8abaa1ed-98d3-4229-a075-107582dc2838 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:36.977331 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8abaa1ed-98d3-4229-a075-107582dc2838 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:36.978093 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8abaa1ed-98d3-4229-a075-107582dc2838 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:36.978527 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8abaa1ed-98d3-4229-a075-107582dc2838 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:37.103957 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-8abaa1ed-98d3-4229-a075-107582dc2838 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:37.111734 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8abaa1ed-98d3-4229-a075-107582dc2838 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.145005 Jul 30 16:11:37.112295 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 387/763] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:36 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:37.317608 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-5849a7c5-7f5e-4bf8-81b0-330047d1e68f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:37.318264 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-5849a7c5-7f5e-4bf8-81b0-330047d1e68f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:37.324180 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5849a7c5-7f5e-4bf8-81b0-330047d1e68f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:37.324625 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5849a7c5-7f5e-4bf8-81b0-330047d1e68f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:37.325418 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5849a7c5-7f5e-4bf8-81b0-330047d1e68f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:37.325853 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5849a7c5-7f5e-4bf8-81b0-330047d1e68f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:37.453868 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-5849a7c5-7f5e-4bf8-81b0-330047d1e68f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:37.461593 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-5849a7c5-7f5e-4bf8-81b0-330047d1e68f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.147710 Jul 30 16:11:37.462154 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 377/764] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:37 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:37.484020 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9b4eca72-4524-4fed-956b-b5674656d9fc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:37.484624 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9b4eca72-4524-4fed-956b-b5674656d9fc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:37.490388 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9b4eca72-4524-4fed-956b-b5674656d9fc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:37.490839 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9b4eca72-4524-4fed-956b-b5674656d9fc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:37.491642 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9b4eca72-4524-4fed-956b-b5674656d9fc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:37.492080 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9b4eca72-4524-4fed-956b-b5674656d9fc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:37.615900 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9b4eca72-4524-4fed-956b-b5674656d9fc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:37.623577 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9b4eca72-4524-4fed-956b-b5674656d9fc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.143676 Jul 30 16:11:37.624342 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 388/765] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:37 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:37.662785 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0f593010-6d2d-44bc-a2ed-86be004b069a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:37.663422 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0f593010-6d2d-44bc-a2ed-86be004b069a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:37.670115 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0f593010-6d2d-44bc-a2ed-86be004b069a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:37.670562 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0f593010-6d2d-44bc-a2ed-86be004b069a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:37.671369 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0f593010-6d2d-44bc-a2ed-86be004b069a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:37.671807 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0f593010-6d2d-44bc-a2ed-86be004b069a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:37.802035 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0f593010-6d2d-44bc-a2ed-86be004b069a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:37.811385 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0f593010-6d2d-44bc-a2ed-86be004b069a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:37.812882 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0f593010-6d2d-44bc-a2ed-86be004b069a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:37.814020 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0f593010-6d2d-44bc-a2ed-86be004b069a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.154969 Jul 30 16:11:37.814583 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 378/766] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:37 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:38.128000 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-76010040-2a46-4e85-9221-a39237624461 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:38.128662 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-76010040-2a46-4e85-9221-a39237624461 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:38.135763 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-76010040-2a46-4e85-9221-a39237624461 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:38.136261 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-76010040-2a46-4e85-9221-a39237624461 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:38.137130 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-76010040-2a46-4e85-9221-a39237624461 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:38.137644 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-76010040-2a46-4e85-9221-a39237624461 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:38.258820 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-76010040-2a46-4e85-9221-a39237624461 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:38.268047 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-76010040-2a46-4e85-9221-a39237624461 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.143634 Jul 30 16:11:38.269264 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 389/767] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:38 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:38.477636 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-456aa576-d9d2-4907-90cd-a9072c1879b2 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:38.478337 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-456aa576-d9d2-4907-90cd-a9072c1879b2 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:38.484440 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-456aa576-d9d2-4907-90cd-a9072c1879b2 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:38.484890 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-456aa576-d9d2-4907-90cd-a9072c1879b2 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:38.485660 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-456aa576-d9d2-4907-90cd-a9072c1879b2 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:38.486097 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-456aa576-d9d2-4907-90cd-a9072c1879b2 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:38.622752 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-456aa576-d9d2-4907-90cd-a9072c1879b2 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:38.630475 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-456aa576-d9d2-4907-90cd-a9072c1879b2 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.156557 Jul 30 16:11:38.631046 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 379/768] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:38 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:38.641186 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-43dc1312-a443-4d1c-8d6d-42a427412bbd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:38.642057 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-43dc1312-a443-4d1c-8d6d-42a427412bbd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:38.647866 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-43dc1312-a443-4d1c-8d6d-42a427412bbd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:38.648322 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-43dc1312-a443-4d1c-8d6d-42a427412bbd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:38.649088 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-43dc1312-a443-4d1c-8d6d-42a427412bbd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:38.649527 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-43dc1312-a443-4d1c-8d6d-42a427412bbd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:38.772902 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-43dc1312-a443-4d1c-8d6d-42a427412bbd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:38.781085 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-43dc1312-a443-4d1c-8d6d-42a427412bbd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.144215 Jul 30 16:11:38.781681 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 390/769] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:38 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:38.831498 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-aa0400e0-c4b0-4958-b48f-4385e3bbd93f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:38.832097 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-aa0400e0-c4b0-4958-b48f-4385e3bbd93f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:38.837978 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aa0400e0-c4b0-4958-b48f-4385e3bbd93f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:38.838356 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aa0400e0-c4b0-4958-b48f-4385e3bbd93f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:38.839103 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aa0400e0-c4b0-4958-b48f-4385e3bbd93f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:38.839558 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aa0400e0-c4b0-4958-b48f-4385e3bbd93f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:38.985422 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-aa0400e0-c4b0-4958-b48f-4385e3bbd93f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:38.997183 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-aa0400e0-c4b0-4958-b48f-4385e3bbd93f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:39.000067 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-aa0400e0-c4b0-4958-b48f-4385e3bbd93f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:39.001792 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-aa0400e0-c4b0-4958-b48f-4385e3bbd93f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.173572 Jul 30 16:11:39.013914 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 380/770] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:38 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:39.286400 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a0069c04-b72f-4a74-bb8f-257d24446453 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:39.287522 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a0069c04-b72f-4a74-bb8f-257d24446453 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:39.298439 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a0069c04-b72f-4a74-bb8f-257d24446453 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:39.298883 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a0069c04-b72f-4a74-bb8f-257d24446453 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:39.299860 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a0069c04-b72f-4a74-bb8f-257d24446453 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:39.299860 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a0069c04-b72f-4a74-bb8f-257d24446453 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:39.442600 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a0069c04-b72f-4a74-bb8f-257d24446453 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:39.450551 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a0069c04-b72f-4a74-bb8f-257d24446453 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.167447 Jul 30 16:11:39.451118 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 391/771] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:39 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:39.648116 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d3265b48-cbe5-4cbf-844f-516e54a2dda5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:39.648697 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d3265b48-cbe5-4cbf-844f-516e54a2dda5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:39.654995 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d3265b48-cbe5-4cbf-844f-516e54a2dda5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:39.655464 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d3265b48-cbe5-4cbf-844f-516e54a2dda5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:39.656221 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d3265b48-cbe5-4cbf-844f-516e54a2dda5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:39.656655 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d3265b48-cbe5-4cbf-844f-516e54a2dda5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:39.783653 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d3265b48-cbe5-4cbf-844f-516e54a2dda5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:39.790992 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d3265b48-cbe5-4cbf-844f-516e54a2dda5 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.146733 Jul 30 16:11:39.791579 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 381/772] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:39 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:39.799056 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b159caf2-3592-42ea-be79-ba318c36f694 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:39.799806 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b159caf2-3592-42ea-be79-ba318c36f694 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:39.805468 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b159caf2-3592-42ea-be79-ba318c36f694 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:39.805916 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b159caf2-3592-42ea-be79-ba318c36f694 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:39.806694 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b159caf2-3592-42ea-be79-ba318c36f694 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:39.807148 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b159caf2-3592-42ea-be79-ba318c36f694 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:39.928372 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b159caf2-3592-42ea-be79-ba318c36f694 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:39.935667 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b159caf2-3592-42ea-be79-ba318c36f694 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.140259 Jul 30 16:11:39.936236 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 392/773] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:39 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:40.021984 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6d34c75c-dd31-4870-8580-3130064be785 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:40.022837 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6d34c75c-dd31-4870-8580-3130064be785 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:40.029577 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6d34c75c-dd31-4870-8580-3130064be785 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:40.030026 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6d34c75c-dd31-4870-8580-3130064be785 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:40.030819 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6d34c75c-dd31-4870-8580-3130064be785 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:40.031287 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6d34c75c-dd31-4870-8580-3130064be785 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:40.150244 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6d34c75c-dd31-4870-8580-3130064be785 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:40.159035 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6d34c75c-dd31-4870-8580-3130064be785 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:40.160587 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6d34c75c-dd31-4870-8580-3130064be785 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:40.161713 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6d34c75c-dd31-4870-8580-3130064be785 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.143712 Jul 30 16:11:40.162262 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 382/774] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:40 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:40.469391 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d6fcfd55-9e30-4174-bffe-1c540cfb87fa tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:40.470182 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d6fcfd55-9e30-4174-bffe-1c540cfb87fa tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:40.475930 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d6fcfd55-9e30-4174-bffe-1c540cfb87fa tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:40.476387 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d6fcfd55-9e30-4174-bffe-1c540cfb87fa tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:40.477156 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d6fcfd55-9e30-4174-bffe-1c540cfb87fa tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:40.477596 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d6fcfd55-9e30-4174-bffe-1c540cfb87fa tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:40.605384 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d6fcfd55-9e30-4174-bffe-1c540cfb87fa tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:40.612952 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d6fcfd55-9e30-4174-bffe-1c540cfb87fa tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.147966 Jul 30 16:11:40.613523 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 393/775] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:40 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:40.808715 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-be09f634-a270-42ec-ba67-b004e72b6fd4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:40.809892 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-be09f634-a270-42ec-ba67-b004e72b6fd4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:40.815613 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-be09f634-a270-42ec-ba67-b004e72b6fd4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:40.816056 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-be09f634-a270-42ec-ba67-b004e72b6fd4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:40.816847 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-be09f634-a270-42ec-ba67-b004e72b6fd4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:40.817278 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-be09f634-a270-42ec-ba67-b004e72b6fd4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:40.938066 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-be09f634-a270-42ec-ba67-b004e72b6fd4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:40.945315 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-be09f634-a270-42ec-ba67-b004e72b6fd4 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.140577 Jul 30 16:11:40.945907 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 383/776] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:40 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:40.952100 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-35feb161-6aaf-491f-b9f7-1a18ed61b685 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:40.952716 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-35feb161-6aaf-491f-b9f7-1a18ed61b685 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:40.958428 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-35feb161-6aaf-491f-b9f7-1a18ed61b685 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:40.958880 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-35feb161-6aaf-491f-b9f7-1a18ed61b685 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:40.959693 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-35feb161-6aaf-491f-b9f7-1a18ed61b685 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:40.960133 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-35feb161-6aaf-491f-b9f7-1a18ed61b685 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:41.082718 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-35feb161-6aaf-491f-b9f7-1a18ed61b685 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:41.090087 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-35feb161-6aaf-491f-b9f7-1a18ed61b685 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.141730 Jul 30 16:11:41.090770 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 394/777] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:40 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:41.180197 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-82ae7a3a-3a00-46ed-9f06-59070b19e465 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:41.180816 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-82ae7a3a-3a00-46ed-9f06-59070b19e465 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:41.187895 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-82ae7a3a-3a00-46ed-9f06-59070b19e465 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:41.188346 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-82ae7a3a-3a00-46ed-9f06-59070b19e465 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:41.189143 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-82ae7a3a-3a00-46ed-9f06-59070b19e465 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:41.189565 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-82ae7a3a-3a00-46ed-9f06-59070b19e465 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:41.313579 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-82ae7a3a-3a00-46ed-9f06-59070b19e465 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:41.322971 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-82ae7a3a-3a00-46ed-9f06-59070b19e465 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:41.324549 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-82ae7a3a-3a00-46ed-9f06-59070b19e465 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:41.325855 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-82ae7a3a-3a00-46ed-9f06-59070b19e465 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.149458 Jul 30 16:11:41.335064 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 384/778] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:41 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:41.629946 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8b4d08a4-802a-45c8-8470-9dd18043a986 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:41.630492 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-8b4d08a4-802a-45c8-8470-9dd18043a986 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:41.636665 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8b4d08a4-802a-45c8-8470-9dd18043a986 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:41.637400 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8b4d08a4-802a-45c8-8470-9dd18043a986 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:41.639018 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8b4d08a4-802a-45c8-8470-9dd18043a986 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:41.639585 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8b4d08a4-802a-45c8-8470-9dd18043a986 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:41.761878 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-8b4d08a4-802a-45c8-8470-9dd18043a986 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:41.769520 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8b4d08a4-802a-45c8-8470-9dd18043a986 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.143277 Jul 30 16:11:41.770082 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 395/779] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:41 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:41.961452 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b7db4433-8fc0-45c4-8bd9-48916070e61e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:41.962053 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b7db4433-8fc0-45c4-8bd9-48916070e61e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:41.968057 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b7db4433-8fc0-45c4-8bd9-48916070e61e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:41.968496 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b7db4433-8fc0-45c4-8bd9-48916070e61e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:41.969246 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b7db4433-8fc0-45c4-8bd9-48916070e61e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:41.969673 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b7db4433-8fc0-45c4-8bd9-48916070e61e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:42.090152 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b7db4433-8fc0-45c4-8bd9-48916070e61e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:42.098381 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b7db4433-8fc0-45c4-8bd9-48916070e61e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.140493 Jul 30 16:11:42.099157 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 385/780] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:41 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:42.108018 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d498dc66-687a-4cd9-a8d6-5e38800b55b8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:42.108632 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d498dc66-687a-4cd9-a8d6-5e38800b55b8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:42.114598 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d498dc66-687a-4cd9-a8d6-5e38800b55b8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:42.115041 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d498dc66-687a-4cd9-a8d6-5e38800b55b8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:42.115872 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d498dc66-687a-4cd9-a8d6-5e38800b55b8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:42.116305 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d498dc66-687a-4cd9-a8d6-5e38800b55b8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:42.241360 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d498dc66-687a-4cd9-a8d6-5e38800b55b8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:42.249464 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d498dc66-687a-4cd9-a8d6-5e38800b55b8 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.146223 Jul 30 16:11:42.250124 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 396/781] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:42 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:42.344723 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-64747d48-520d-40a5-80b5-90b69a274cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:42.345334 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-64747d48-520d-40a5-80b5-90b69a274cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:42.351235 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-64747d48-520d-40a5-80b5-90b69a274cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:42.351688 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-64747d48-520d-40a5-80b5-90b69a274cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:42.352487 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-64747d48-520d-40a5-80b5-90b69a274cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:42.353374 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-64747d48-520d-40a5-80b5-90b69a274cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:42.472320 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-64747d48-520d-40a5-80b5-90b69a274cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:42.480583 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-64747d48-520d-40a5-80b5-90b69a274cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:42.482341 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-64747d48-520d-40a5-80b5-90b69a274cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:42.483513 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-64747d48-520d-40a5-80b5-90b69a274cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.143103 Jul 30 16:11:42.484088 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 386/782] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:42 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:42.786315 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c83011e1-14f2-4567-bd48-68179450532e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:42.786923 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c83011e1-14f2-4567-bd48-68179450532e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:42.792746 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c83011e1-14f2-4567-bd48-68179450532e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:42.793201 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c83011e1-14f2-4567-bd48-68179450532e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:42.793998 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c83011e1-14f2-4567-bd48-68179450532e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:42.794430 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c83011e1-14f2-4567-bd48-68179450532e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:42.913330 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c83011e1-14f2-4567-bd48-68179450532e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:42.920963 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c83011e1-14f2-4567-bd48-68179450532e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.138320 Jul 30 16:11:42.921524 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 397/783] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:42 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:43.114990 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8caf54c5-b8cb-48ae-9c25-c478f96db8f8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:43.115635 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8caf54c5-b8cb-48ae-9c25-c478f96db8f8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:43.121527 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8caf54c5-b8cb-48ae-9c25-c478f96db8f8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:43.122593 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8caf54c5-b8cb-48ae-9c25-c478f96db8f8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:43.123418 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8caf54c5-b8cb-48ae-9c25-c478f96db8f8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:43.123856 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8caf54c5-b8cb-48ae-9c25-c478f96db8f8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:43.243466 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8caf54c5-b8cb-48ae-9c25-c478f96db8f8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:43.251569 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8caf54c5-b8cb-48ae-9c25-c478f96db8f8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.140236 Jul 30 16:11:43.252116 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 387/784] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:43 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:43.265565 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d9a1c35c-fb8b-465e-a570-2595fac3a1e6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:43.266170 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d9a1c35c-fb8b-465e-a570-2595fac3a1e6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:43.272201 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d9a1c35c-fb8b-465e-a570-2595fac3a1e6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:43.272641 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d9a1c35c-fb8b-465e-a570-2595fac3a1e6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:43.273398 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d9a1c35c-fb8b-465e-a570-2595fac3a1e6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:43.273824 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d9a1c35c-fb8b-465e-a570-2595fac3a1e6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:43.393082 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d9a1c35c-fb8b-465e-a570-2595fac3a1e6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:43.400532 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d9a1c35c-fb8b-465e-a570-2595fac3a1e6 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.138777 Jul 30 16:11:43.401089 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 398/785] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:43 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:43.503644 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f81e9df4-37d2-4501-b1ab-c55d091314e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:43.504252 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f81e9df4-37d2-4501-b1ab-c55d091314e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:43.510029 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f81e9df4-37d2-4501-b1ab-c55d091314e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:43.510476 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f81e9df4-37d2-4501-b1ab-c55d091314e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:43.511267 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f81e9df4-37d2-4501-b1ab-c55d091314e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:43.511703 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f81e9df4-37d2-4501-b1ab-c55d091314e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:43.632814 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f81e9df4-37d2-4501-b1ab-c55d091314e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:43.641124 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f81e9df4-37d2-4501-b1ab-c55d091314e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:43.642864 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f81e9df4-37d2-4501-b1ab-c55d091314e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:43.644007 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f81e9df4-37d2-4501-b1ab-c55d091314e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.144112 Jul 30 16:11:43.644560 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 388/786] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:43 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:43.937687 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ffa83649-c1af-4081-b107-71225c85ac9b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:43.938221 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ffa83649-c1af-4081-b107-71225c85ac9b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:43.944048 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ffa83649-c1af-4081-b107-71225c85ac9b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:43.944498 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ffa83649-c1af-4081-b107-71225c85ac9b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:43.945287 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ffa83649-c1af-4081-b107-71225c85ac9b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:43.945702 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ffa83649-c1af-4081-b107-71225c85ac9b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:44.070637 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ffa83649-c1af-4081-b107-71225c85ac9b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:44.078672 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ffa83649-c1af-4081-b107-71225c85ac9b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.144950 Jul 30 16:11:44.079276 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 399/787] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:43 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:44.268533 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1f188b7e-f396-4a66-bec5-e0b828e4d339 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:44.269264 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1f188b7e-f396-4a66-bec5-e0b828e4d339 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:44.275178 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f188b7e-f396-4a66-bec5-e0b828e4d339 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:44.275749 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f188b7e-f396-4a66-bec5-e0b828e4d339 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:44.276554 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f188b7e-f396-4a66-bec5-e0b828e4d339 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:44.277128 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f188b7e-f396-4a66-bec5-e0b828e4d339 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:44.417334 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-77f876db-ef9e-4bea-bc36-4c6e646763a7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:44.417941 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-77f876db-ef9e-4bea-bc36-4c6e646763a7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:44.423926 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-77f876db-ef9e-4bea-bc36-4c6e646763a7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:44.424371 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-77f876db-ef9e-4bea-bc36-4c6e646763a7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:44.425132 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-77f876db-ef9e-4bea-bc36-4c6e646763a7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:44.425560 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-77f876db-ef9e-4bea-bc36-4c6e646763a7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:44.433730 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1f188b7e-f396-4a66-bec5-e0b828e4d339 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:44.443162 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1f188b7e-f396-4a66-bec5-e0b828e4d339 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.178014 Jul 30 16:11:44.443382 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 389/788] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:44 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:44.545376 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-77f876db-ef9e-4bea-bc36-4c6e646763a7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:44.552517 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-77f876db-ef9e-4bea-bc36-4c6e646763a7 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.138944 Jul 30 16:11:44.553071 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 400/789] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:44 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:44.661433 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-5b029c36-4063-49e6-9190-ea18bb5ffc79 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:44.662045 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-5b029c36-4063-49e6-9190-ea18bb5ffc79 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:44.667955 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5b029c36-4063-49e6-9190-ea18bb5ffc79 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:44.668407 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5b029c36-4063-49e6-9190-ea18bb5ffc79 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:44.670088 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5b029c36-4063-49e6-9190-ea18bb5ffc79 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:44.670527 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5b029c36-4063-49e6-9190-ea18bb5ffc79 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:44.787947 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-5b029c36-4063-49e6-9190-ea18bb5ffc79 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:44.796505 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-5b029c36-4063-49e6-9190-ea18bb5ffc79 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:44.797917 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-5b029c36-4063-49e6-9190-ea18bb5ffc79 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:44.799028 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-5b029c36-4063-49e6-9190-ea18bb5ffc79 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.141313 Jul 30 16:11:44.799602 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 390/790] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:44 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:45.095416 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-08bdf3b9-8740-4ed7-8f83-03fe15dac3ed tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:45.095932 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-08bdf3b9-8740-4ed7-8f83-03fe15dac3ed tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:45.101743 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-08bdf3b9-8740-4ed7-8f83-03fe15dac3ed tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:45.102190 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-08bdf3b9-8740-4ed7-8f83-03fe15dac3ed tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:45.102961 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-08bdf3b9-8740-4ed7-8f83-03fe15dac3ed tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:45.103419 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-08bdf3b9-8740-4ed7-8f83-03fe15dac3ed tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:45.221087 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-08bdf3b9-8740-4ed7-8f83-03fe15dac3ed tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:45.228191 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-08bdf3b9-8740-4ed7-8f83-03fe15dac3ed tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1319 microversion: 2.1 time: 0.136614 Jul 30 16:11:45.228753 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 401/791] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:45 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1319 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:45.460020 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-06293e1e-c771-4f70-b1ab-43d1bcccb332 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:45.460626 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-06293e1e-c771-4f70-b1ab-43d1bcccb332 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:45.467063 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-06293e1e-c771-4f70-b1ab-43d1bcccb332 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:45.467537 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-06293e1e-c771-4f70-b1ab-43d1bcccb332 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:45.468373 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-06293e1e-c771-4f70-b1ab-43d1bcccb332 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:45.468908 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-06293e1e-c771-4f70-b1ab-43d1bcccb332 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:45.569498 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d10a9332-f4e3-4d39-8172-c6d398e724c1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:45.570210 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d10a9332-f4e3-4d39-8172-c6d398e724c1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:45.576667 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d10a9332-f4e3-4d39-8172-c6d398e724c1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:45.577188 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d10a9332-f4e3-4d39-8172-c6d398e724c1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:45.578025 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d10a9332-f4e3-4d39-8172-c6d398e724c1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:45.578466 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d10a9332-f4e3-4d39-8172-c6d398e724c1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:45.585085 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-06293e1e-c771-4f70-b1ab-43d1bcccb332 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:45.593178 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-06293e1e-c771-4f70-b1ab-43d1bcccb332 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.136849 Jul 30 16:11:45.593740 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 391/792] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:45 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:45.698795 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d10a9332-f4e3-4d39-8172-c6d398e724c1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:45.706840 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d10a9332-f4e3-4d39-8172-c6d398e724c1 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.141000 Jul 30 16:11:45.707436 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 402/793] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:45 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:45.817740 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-83d793d3-9e1b-4ee1-b2ce-8531b7b74660 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:45.818291 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-83d793d3-9e1b-4ee1-b2ce-8531b7b74660 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:45.824267 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-83d793d3-9e1b-4ee1-b2ce-8531b7b74660 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:45.824845 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-83d793d3-9e1b-4ee1-b2ce-8531b7b74660 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:45.826190 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-83d793d3-9e1b-4ee1-b2ce-8531b7b74660 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:45.826630 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-83d793d3-9e1b-4ee1-b2ce-8531b7b74660 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:45.945567 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-83d793d3-9e1b-4ee1-b2ce-8531b7b74660 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:45.954740 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-83d793d3-9e1b-4ee1-b2ce-8531b7b74660 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:45.956352 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-83d793d3-9e1b-4ee1-b2ce-8531b7b74660 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:45.957497 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-83d793d3-9e1b-4ee1-b2ce-8531b7b74660 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.143589 Jul 30 16:11:45.958049 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 392/794] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:45 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:46.245887 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-7f250022-f711-41d4-b807-165726bc3923 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:46.246524 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-7f250022-f711-41d4-b807-165726bc3923 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:46.252916 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7f250022-f711-41d4-b807-165726bc3923 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:46.253366 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7f250022-f711-41d4-b807-165726bc3923 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:46.254191 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7f250022-f711-41d4-b807-165726bc3923 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:46.254623 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7f250022-f711-41d4-b807-165726bc3923 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:46.376685 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-7f250022-f711-41d4-b807-165726bc3923 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:46.383845 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-7f250022-f711-41d4-b807-165726bc3923 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1509 microversion: 2.1 time: 0.142298 Jul 30 16:11:46.384410 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 403/795] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:46 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1509 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:46.400197 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-87a6d0b5-474a-469d-b72e-4d3d442dd641 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d056b39-da51-4da9-a986-b540c64000ad", "device": "/dev/sdb"}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:11:46.401743 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-87a6d0b5-474a-469d-b72e-4d3d442dd641 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:46.407667 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-87a6d0b5-474a-469d-b72e-4d3d442dd641 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:46.408121 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-87a6d0b5-474a-469d-b72e-4d3d442dd641 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:46.408886 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-87a6d0b5-474a-469d-b72e-4d3d442dd641 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:46.409318 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-87a6d0b5-474a-469d-b72e-4d3d442dd641 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:46.610246 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f01f809e-8c5e-4a45-883d-18b0b348646d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:46.610849 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f01f809e-8c5e-4a45-883d-18b0b348646d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:46.616706 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f01f809e-8c5e-4a45-883d-18b0b348646d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:46.617156 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f01f809e-8c5e-4a45-883d-18b0b348646d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:46.617921 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f01f809e-8c5e-4a45-883d-18b0b348646d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:46.618356 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f01f809e-8c5e-4a45-883d-18b0b348646d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:46.657357 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-87a6d0b5-474a-469d-b72e-4d3d442dd641 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "POST /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260699 Jul 30 16:11:46.658326 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 393/796] 10.222.0.37 () {60 vars in 1323 bytes} [Fri Jul 30 16:11:46 2021] POST /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:11:46.727887 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e7e80918-eff6-4708-9c82-af88bae0140f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:46.728589 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e7e80918-eff6-4708-9c82-af88bae0140f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:46.735457 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e7e80918-eff6-4708-9c82-af88bae0140f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:46.735942 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e7e80918-eff6-4708-9c82-af88bae0140f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:46.736717 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e7e80918-eff6-4708-9c82-af88bae0140f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:46.737299 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e7e80918-eff6-4708-9c82-af88bae0140f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:46.750450 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f01f809e-8c5e-4a45-883d-18b0b348646d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:46.758698 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f01f809e-8c5e-4a45-883d-18b0b348646d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.152602 Jul 30 16:11:46.759591 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 404/797] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:46 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:46.862106 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e7e80918-eff6-4708-9c82-af88bae0140f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:46.870509 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e7e80918-eff6-4708-9c82-af88bae0140f tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.146575 Jul 30 16:11:46.871169 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 394/798] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:46 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:46.975587 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-315cbff3-f341-46c5-984e-b2cdc0b00dc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:46.976187 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-315cbff3-f341-46c5-984e-b2cdc0b00dc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:46.982353 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-315cbff3-f341-46c5-984e-b2cdc0b00dc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:46.982794 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-315cbff3-f341-46c5-984e-b2cdc0b00dc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:46.983579 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-315cbff3-f341-46c5-984e-b2cdc0b00dc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:46.984003 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-315cbff3-f341-46c5-984e-b2cdc0b00dc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:47.109542 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-315cbff3-f341-46c5-984e-b2cdc0b00dc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:47.119606 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-315cbff3-f341-46c5-984e-b2cdc0b00dc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:47.119898 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-315cbff3-f341-46c5-984e-b2cdc0b00dc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:47.121040 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-315cbff3-f341-46c5-984e-b2cdc0b00dc7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.149148 Jul 30 16:11:47.121690 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 405/799] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:46 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:47.779642 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6201b1d9-7c1a-4f39-9bd2-3bd5c32dcffc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:47.780371 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6201b1d9-7c1a-4f39-9bd2-3bd5c32dcffc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:47.786886 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6201b1d9-7c1a-4f39-9bd2-3bd5c32dcffc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:47.787429 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6201b1d9-7c1a-4f39-9bd2-3bd5c32dcffc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:47.788207 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6201b1d9-7c1a-4f39-9bd2-3bd5c32dcffc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:47.788639 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6201b1d9-7c1a-4f39-9bd2-3bd5c32dcffc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:47.888203 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-de12c8dd-b314-4ceb-96ac-096e60589834 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:47.888987 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-de12c8dd-b314-4ceb-96ac-096e60589834 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:47.894827 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-de12c8dd-b314-4ceb-96ac-096e60589834 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:47.895311 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-de12c8dd-b314-4ceb-96ac-096e60589834 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:47.896090 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-de12c8dd-b314-4ceb-96ac-096e60589834 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:47.896526 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-de12c8dd-b314-4ceb-96ac-096e60589834 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:48.017562 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-de12c8dd-b314-4ceb-96ac-096e60589834 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:48.021861 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6201b1d9-7c1a-4f39-9bd2-3bd5c32dcffc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:48.026155 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-de12c8dd-b314-4ceb-96ac-096e60589834 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.141392 Jul 30 16:11:48.026155 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 406/800] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:47 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:48.030538 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6201b1d9-7c1a-4f39-9bd2-3bd5c32dcffc tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1513 microversion: 2.1 time: 0.258098 Jul 30 16:11:48.031220 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 395/801] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:47 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1513 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:48.141390 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-68340bd3-1e13-4905-a6f3-3b6078dd9f34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:48.142252 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-68340bd3-1e13-4905-a6f3-3b6078dd9f34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:48.147989 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-68340bd3-1e13-4905-a6f3-3b6078dd9f34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:48.148440 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-68340bd3-1e13-4905-a6f3-3b6078dd9f34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:48.149244 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-68340bd3-1e13-4905-a6f3-3b6078dd9f34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:48.149675 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-68340bd3-1e13-4905-a6f3-3b6078dd9f34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:48.276528 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-68340bd3-1e13-4905-a6f3-3b6078dd9f34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:48.285279 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-68340bd3-1e13-4905-a6f3-3b6078dd9f34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:48.286790 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-68340bd3-1e13-4905-a6f3-3b6078dd9f34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:48.287970 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-68340bd3-1e13-4905-a6f3-3b6078dd9f34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.150969 Jul 30 16:11:48.288534 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 407/802] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:48 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:48.589849 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-c162a785-77d7-4782-bc86-d23201084be2 req-f101dd99-f39a-44f8-81b8-7280a64330b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449fc7f2-a7de-4c24-928e-9bd3294b773f", "name": "network-vif-deleted", "tag": "52e600d7-de11-4a97-8436-e389bd5707d1"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:11:48.592029 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:11:48.592029 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:11:48.598800 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-c162a785-77d7-4782-bc86-d23201084be2 req-f101dd99-f39a-44f8-81b8-7280a64330b7 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:48.599272 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-c162a785-77d7-4782-bc86-d23201084be2 req-f101dd99-f39a-44f8-81b8-7280a64330b7 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:48.609843 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-c162a785-77d7-4782-bc86-d23201084be2 req-f101dd99-f39a-44f8-81b8-7280a64330b7 service nova] Creating event network-vif-deleted:52e600d7-de11-4a97-8436-e389bd5707d1 for instance 449fc7f2-a7de-4c24-928e-9bd3294b773f on hv-cinder-80304 Jul 30 16:11:48.614353 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-c162a785-77d7-4782-bc86-d23201084be2 req-f101dd99-f39a-44f8-81b8-7280a64330b7 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028126 Jul 30 16:11:48.614934 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 396/803] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:11:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:11:49.042167 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9dfaefc0-6fce-4984-a17f-a0f3bba628dd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:49.042768 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9dfaefc0-6fce-4984-a17f-a0f3bba628dd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:49.048582 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9ce5dcd6-d18b-43ec-b2ec-3706e0f915e8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:49.049038 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9dfaefc0-6fce-4984-a17f-a0f3bba628dd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:49.049363 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9dfaefc0-6fce-4984-a17f-a0f3bba628dd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:49.049512 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9ce5dcd6-d18b-43ec-b2ec-3706e0f915e8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:49.050122 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9dfaefc0-6fce-4984-a17f-a0f3bba628dd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:49.050550 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9dfaefc0-6fce-4984-a17f-a0f3bba628dd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:49.055452 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9ce5dcd6-d18b-43ec-b2ec-3706e0f915e8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:49.055903 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9ce5dcd6-d18b-43ec-b2ec-3706e0f915e8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:49.056674 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9ce5dcd6-d18b-43ec-b2ec-3706e0f915e8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:49.057112 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9ce5dcd6-d18b-43ec-b2ec-3706e0f915e8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:49.091108 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9ce5dcd6-d18b-43ec-b2ec-3706e0f915e8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:49.091495 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9ce5dcd6-d18b-43ec-b2ec-3706e0f915e8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:49.092525 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.objects.instance [None req-9ce5dcd6-d18b-43ec-b2ec-3706e0f915e8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lazy-loading 'fault' on Instance uuid 449fc7f2-a7de-4c24-928e-9bd3294b773f {{(pid=107452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:11:49.134085 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9ce5dcd6-d18b-43ec-b2ec-3706e0f915e8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:49.142530 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9ce5dcd6-d18b-43ec-b2ec-3706e0f915e8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 200 len: 1307 microversion: 2.1 time: 0.097626 Jul 30 16:11:49.143099 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 397/804] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:49 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:49.233887 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9dfaefc0-6fce-4984-a17f-a0f3bba628dd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:49.240641 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9dfaefc0-6fce-4984-a17f-a0f3bba628dd tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.202115 Jul 30 16:11:49.241201 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 408/805] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:49 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:49.305687 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-59d43a2b-8c22-4540-aae2-5822c1838714 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:49.306388 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-59d43a2b-8c22-4540-aae2-5822c1838714 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:49.312935 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59d43a2b-8c22-4540-aae2-5822c1838714 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:49.313378 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59d43a2b-8c22-4540-aae2-5822c1838714 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:49.314131 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59d43a2b-8c22-4540-aae2-5822c1838714 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:49.314561 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59d43a2b-8c22-4540-aae2-5822c1838714 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:49.437254 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-59d43a2b-8c22-4540-aae2-5822c1838714 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:49.445712 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-59d43a2b-8c22-4540-aae2-5822c1838714 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:49.447254 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-59d43a2b-8c22-4540-aae2-5822c1838714 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:49.448373 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-59d43a2b-8c22-4540-aae2-5822c1838714 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.146519 Jul 30 16:11:49.448916 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 398/806] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:49 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:50.159539 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-61148693-b363-49d3-963a-4e36dddece1e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:50.160045 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-61148693-b363-49d3-963a-4e36dddece1e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: 449fc7f2-a7de-4c24-928e-9bd3294b773f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:50.165864 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-61148693-b363-49d3-963a-4e36dddece1e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:50.166309 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-61148693-b363-49d3-963a-4e36dddece1e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:50.167074 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-61148693-b363-49d3-963a-4e36dddece1e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:50.167533 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-61148693-b363-49d3-963a-4e36dddece1e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:50.180527 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-61148693-b363-49d3-963a-4e36dddece1e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] HTTP exception thrown: Instance 449fc7f2-a7de-4c24-928e-9bd3294b773f could not be found. Jul 30 16:11:50.181104 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-61148693-b363-49d3-963a-4e36dddece1e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Returning 404 to user: Instance 449fc7f2-a7de-4c24-928e-9bd3294b773f could not be found. {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:11:50.181911 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-61148693-b363-49d3-963a-4e36dddece1e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f" status: 404 len: 111 microversion: 2.1 time: 0.026201 Jul 30 16:11:50.182414 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 409/807] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:50 2021] GET /compute/v2.1/servers/449fc7f2-a7de-4c24-928e-9bd3294b773f => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:11:50.190105 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-39db8a39-ef39-401d-83ce-0eede0ccfe5e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:50.190598 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-39db8a39-ef39-401d-83ce-0eede0ccfe5e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:50.196771 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-39db8a39-ef39-401d-83ce-0eede0ccfe5e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:50.197211 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-39db8a39-ef39-401d-83ce-0eede0ccfe5e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:50.197966 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-39db8a39-ef39-401d-83ce-0eede0ccfe5e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:50.198389 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-39db8a39-ef39-401d-83ce-0eede0ccfe5e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:50.224314 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-39db8a39-ef39-401d-83ce-0eede0ccfe5e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Going to try to terminate instance {{(pid=107452) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:11:50.257434 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ab9b99f3-e162-4147-9f9f-accb924fdc54 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:50.258093 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ab9b99f3-e162-4147-9f9f-accb924fdc54 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:50.264951 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ab9b99f3-e162-4147-9f9f-accb924fdc54 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:50.265397 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ab9b99f3-e162-4147-9f9f-accb924fdc54 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:50.266188 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ab9b99f3-e162-4147-9f9f-accb924fdc54 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:50.266626 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ab9b99f3-e162-4147-9f9f-accb924fdc54 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:50.301167 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-39db8a39-ef39-401d-83ce-0eede0ccfe5e tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "DELETE /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8" status: 204 len: 0 microversion: 2.1 time: 0.114071 Jul 30 16:11:50.301778 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 399/808] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:11:50 2021] DELETE /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 16:11:50.310858 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-59c66dd3-ac74-41e1-a954-d46b26b19192 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:50.311835 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-59c66dd3-ac74-41e1-a954-d46b26b19192 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:50.317570 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59c66dd3-ac74-41e1-a954-d46b26b19192 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:50.318008 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59c66dd3-ac74-41e1-a954-d46b26b19192 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:50.318766 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59c66dd3-ac74-41e1-a954-d46b26b19192 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:50.319253 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59c66dd3-ac74-41e1-a954-d46b26b19192 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:50.394722 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ab9b99f3-e162-4147-9f9f-accb924fdc54 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:50.402038 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ab9b99f3-e162-4147-9f9f-accb924fdc54 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.148192 Jul 30 16:11:50.402604 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 410/809] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:50 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:50.446546 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-59c66dd3-ac74-41e1-a954-d46b26b19192 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:50.454744 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-59c66dd3-ac74-41e1-a954-d46b26b19192 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8" status: 200 len: 1514 microversion: 2.1 time: 0.148479 Jul 30 16:11:50.455377 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 400/810] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:50 2021] GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:50.465668 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3f52fed2-4b59-4e5a-be64-df3fc2d7cee6 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:50.466435 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-3f52fed2-4b59-4e5a-be64-df3fc2d7cee6 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:50.472229 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3f52fed2-4b59-4e5a-be64-df3fc2d7cee6 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:50.472682 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3f52fed2-4b59-4e5a-be64-df3fc2d7cee6 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:50.473451 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3f52fed2-4b59-4e5a-be64-df3fc2d7cee6 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:50.473890 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3f52fed2-4b59-4e5a-be64-df3fc2d7cee6 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:50.593157 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3f52fed2-4b59-4e5a-be64-df3fc2d7cee6 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:50.601335 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3f52fed2-4b59-4e5a-be64-df3fc2d7cee6 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:50.602814 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3f52fed2-4b59-4e5a-be64-df3fc2d7cee6 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:50.603966 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-3f52fed2-4b59-4e5a-be64-df3fc2d7cee6 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.142148 Jul 30 16:11:50.604511 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 411/811] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:50 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:11:51.420443 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6483c8f4-467a-4232-8799-f0f3b3c5ebcc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:51.421051 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6483c8f4-467a-4232-8799-f0f3b3c5ebcc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:51.426885 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6483c8f4-467a-4232-8799-f0f3b3c5ebcc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:51.427355 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6483c8f4-467a-4232-8799-f0f3b3c5ebcc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:51.428115 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6483c8f4-467a-4232-8799-f0f3b3c5ebcc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:51.428565 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6483c8f4-467a-4232-8799-f0f3b3c5ebcc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:51.471829 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-7032c3c4-104a-4707-8009-2311ed905e66 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:51.472474 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-7032c3c4-104a-4707-8009-2311ed905e66 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:51.478241 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7032c3c4-104a-4707-8009-2311ed905e66 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:51.478691 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7032c3c4-104a-4707-8009-2311ed905e66 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:51.479494 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7032c3c4-104a-4707-8009-2311ed905e66 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:51.479933 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7032c3c4-104a-4707-8009-2311ed905e66 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:51.547829 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6483c8f4-467a-4232-8799-f0f3b3c5ebcc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:51.555482 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6483c8f4-467a-4232-8799-f0f3b3c5ebcc tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.139348 Jul 30 16:11:51.556052 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 401/812] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:51 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:51.602852 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-7032c3c4-104a-4707-8009-2311ed905e66 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:51.610656 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-7032c3c4-104a-4707-8009-2311ed905e66 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8" status: 200 len: 1514 microversion: 2.1 time: 0.142490 Jul 30 16:11:51.611235 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 412/813] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:51 2021] GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 => generated 1514 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:51.621363 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-979f2e2c-861c-4657-bac9-6ea200a54482 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:51.622570 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-979f2e2c-861c-4657-bac9-6ea200a54482 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:51.628351 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-979f2e2c-861c-4657-bac9-6ea200a54482 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:51.628799 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-979f2e2c-861c-4657-bac9-6ea200a54482 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:51.629562 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-979f2e2c-861c-4657-bac9-6ea200a54482 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:51.629995 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-979f2e2c-861c-4657-bac9-6ea200a54482 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:51.748544 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-979f2e2c-861c-4657-bac9-6ea200a54482 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:51.756554 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-979f2e2c-861c-4657-bac9-6ea200a54482 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:51.758041 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-979f2e2c-861c-4657-bac9-6ea200a54482 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:51.759182 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-979f2e2c-861c-4657-bac9-6ea200a54482 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.141479 Jul 30 16:11:51.759741 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 402/814] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:51 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:52.572185 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-5a8671a8-fdb9-488a-9723-c85b1edc7f7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:52.572726 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-5a8671a8-fdb9-488a-9723-c85b1edc7f7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:52.579380 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5a8671a8-fdb9-488a-9723-c85b1edc7f7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:52.579842 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5a8671a8-fdb9-488a-9723-c85b1edc7f7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:52.580610 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5a8671a8-fdb9-488a-9723-c85b1edc7f7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:52.581048 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5a8671a8-fdb9-488a-9723-c85b1edc7f7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:52.627322 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a1089d89-6758-484d-87b8-e1696a5660c8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:52.627933 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a1089d89-6758-484d-87b8-e1696a5660c8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:52.633800 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a1089d89-6758-484d-87b8-e1696a5660c8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:52.634251 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a1089d89-6758-484d-87b8-e1696a5660c8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:52.635012 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a1089d89-6758-484d-87b8-e1696a5660c8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:52.635504 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a1089d89-6758-484d-87b8-e1696a5660c8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:52.701077 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-5a8671a8-fdb9-488a-9723-c85b1edc7f7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:52.708270 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-5a8671a8-fdb9-488a-9723-c85b1edc7f7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.139821 Jul 30 16:11:52.708819 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 413/815] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:52 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:52.758659 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-a1089d89-6758-484d-87b8-e1696a5660c8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:52.766690 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a1089d89-6758-484d-87b8-e1696a5660c8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8" status: 200 len: 1514 microversion: 2.1 time: 0.142984 Jul 30 16:11:52.767549 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 403/816] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:52 2021] GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 => generated 1514 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:52.776890 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b8c5b32e-5db6-4e52-a3d0-ca0641362cf1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:52.777489 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b8c5b32e-5db6-4e52-a3d0-ca0641362cf1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:52.783194 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b8c5b32e-5db6-4e52-a3d0-ca0641362cf1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:52.783635 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b8c5b32e-5db6-4e52-a3d0-ca0641362cf1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:52.784392 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b8c5b32e-5db6-4e52-a3d0-ca0641362cf1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:52.784815 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b8c5b32e-5db6-4e52-a3d0-ca0641362cf1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:52.901680 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b8c5b32e-5db6-4e52-a3d0-ca0641362cf1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:52.909810 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b8c5b32e-5db6-4e52-a3d0-ca0641362cf1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:52.911325 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b8c5b32e-5db6-4e52-a3d0-ca0641362cf1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:52.912443 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b8c5b32e-5db6-4e52-a3d0-ca0641362cf1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.139184 Jul 30 16:11:52.912988 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 414/817] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:52 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:53.724210 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-aae16edb-5fa1-413c-8e6c-f7b366d2a0be tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:53.724976 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-aae16edb-5fa1-413c-8e6c-f7b366d2a0be tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:53.733473 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aae16edb-5fa1-413c-8e6c-f7b366d2a0be tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:53.734154 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aae16edb-5fa1-413c-8e6c-f7b366d2a0be tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:53.734885 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aae16edb-5fa1-413c-8e6c-f7b366d2a0be tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:53.735406 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aae16edb-5fa1-413c-8e6c-f7b366d2a0be tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:53.747818 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-ed7149eb-2ccf-4f02-8de1-4564757817ff req-a0daef09-16d3-47ff-89ab-747a5ba329bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8", "name": "network-vif-deleted", "tag": "93b5bd35-b14d-4747-b351-ad0f4291d3bf"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:11:53.749622 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:11:53.749622 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:11:53.761824 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-ed7149eb-2ccf-4f02-8de1-4564757817ff req-a0daef09-16d3-47ff-89ab-747a5ba329bf service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:53.771352 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-ed7149eb-2ccf-4f02-8de1-4564757817ff req-a0daef09-16d3-47ff-89ab-747a5ba329bf service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:53.790441 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-ed7149eb-2ccf-4f02-8de1-4564757817ff req-a0daef09-16d3-47ff-89ab-747a5ba329bf service nova] Creating event network-vif-deleted:93b5bd35-b14d-4747-b351-ad0f4291d3bf for instance fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 on hv-cinder-80304 Jul 30 16:11:53.797041 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-ed7149eb-2ccf-4f02-8de1-4564757817ff req-a0daef09-16d3-47ff-89ab-747a5ba329bf service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053523 Jul 30 16:11:53.798204 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 415/818] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:11:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:11:53.804737 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b4d04ad5-20e2-4283-b4fd-469fa9c10af7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:53.805645 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b4d04ad5-20e2-4283-b4fd-469fa9c10af7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:53.812741 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b4d04ad5-20e2-4283-b4fd-469fa9c10af7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:53.813411 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b4d04ad5-20e2-4283-b4fd-469fa9c10af7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:53.814521 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b4d04ad5-20e2-4283-b4fd-469fa9c10af7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:53.815120 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b4d04ad5-20e2-4283-b4fd-469fa9c10af7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:53.898222 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b4d04ad5-20e2-4283-b4fd-469fa9c10af7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:53.907292 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b4d04ad5-20e2-4283-b4fd-469fa9c10af7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8" status: 200 len: 1303 microversion: 2.1 time: 0.107552 Jul 30 16:11:53.907869 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 416/819] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:53 2021] GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:53.920568 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-aae16edb-5fa1-413c-8e6c-f7b366d2a0be tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:53.928754 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-aae16edb-5fa1-413c-8e6c-f7b366d2a0be tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.208136 Jul 30 16:11:53.929322 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 404/820] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:53 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:53.931246 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-5b4383b2-e418-4464-8a7e-00b2b8b3ddda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:53.931921 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-5b4383b2-e418-4464-8a7e-00b2b8b3ddda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:53.938786 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5b4383b2-e418-4464-8a7e-00b2b8b3ddda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:53.939266 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5b4383b2-e418-4464-8a7e-00b2b8b3ddda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:53.940101 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5b4383b2-e418-4464-8a7e-00b2b8b3ddda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:53.940544 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5b4383b2-e418-4464-8a7e-00b2b8b3ddda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:54.060942 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-5b4383b2-e418-4464-8a7e-00b2b8b3ddda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:54.069204 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-5b4383b2-e418-4464-8a7e-00b2b8b3ddda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:54.070704 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-5b4383b2-e418-4464-8a7e-00b2b8b3ddda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:54.071872 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-5b4383b2-e418-4464-8a7e-00b2b8b3ddda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.145051 Jul 30 16:11:54.072995 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 417/821] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:53 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:11:54.924112 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d9a9512a-30b9-4df5-a91d-df9f24fc5895 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:54.924724 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d9a9512a-30b9-4df5-a91d-df9f24fc5895 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:54.930965 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d9a9512a-30b9-4df5-a91d-df9f24fc5895 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:54.931455 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d9a9512a-30b9-4df5-a91d-df9f24fc5895 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:54.932225 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d9a9512a-30b9-4df5-a91d-df9f24fc5895 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:54.932663 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d9a9512a-30b9-4df5-a91d-df9f24fc5895 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:54.945428 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-83fd3121-d65d-4dc8-b10c-2c0aafe5afeb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:54.946035 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-83fd3121-d65d-4dc8-b10c-2c0aafe5afeb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:54.946164 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-d9a9512a-30b9-4df5-a91d-df9f24fc5895 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] HTTP exception thrown: Instance fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 could not be found. Jul 30 16:11:54.946707 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d9a9512a-30b9-4df5-a91d-df9f24fc5895 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Returning 404 to user: Instance fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:11:54.947561 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d9a9512a-30b9-4df5-a91d-df9f24fc5895 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8" status: 404 len: 111 microversion: 2.1 time: 0.027133 Jul 30 16:11:54.948089 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 405/822] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:54 2021] GET /compute/v2.1/servers/fb6b2b5e-7ea6-40cf-9045-8db257c6a3c8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:11:54.952041 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-83fd3121-d65d-4dc8-b10c-2c0aafe5afeb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:54.952493 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-83fd3121-d65d-4dc8-b10c-2c0aafe5afeb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:54.953271 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-83fd3121-d65d-4dc8-b10c-2c0aafe5afeb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:54.953811 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-83fd3121-d65d-4dc8-b10c-2c0aafe5afeb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:55.091384 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b9441d93-d699-447b-83c3-6b9b89629368 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:55.092230 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b9441d93-d699-447b-83c3-6b9b89629368 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:55.094328 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-83fd3121-d65d-4dc8-b10c-2c0aafe5afeb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:55.099637 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b9441d93-d699-447b-83c3-6b9b89629368 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:55.100558 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b9441d93-d699-447b-83c3-6b9b89629368 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:55.101360 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b9441d93-d699-447b-83c3-6b9b89629368 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:55.101835 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b9441d93-d699-447b-83c3-6b9b89629368 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:55.101962 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-83fd3121-d65d-4dc8-b10c-2c0aafe5afeb tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1521 microversion: 2.1 time: 0.160209 Jul 30 16:11:55.102764 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 418/823] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:54 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:55.250374 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b9441d93-d699-447b-83c3-6b9b89629368 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:55.258576 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b9441d93-d699-447b-83c3-6b9b89629368 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:55.260110 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b9441d93-d699-447b-83c3-6b9b89629368 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:55.261267 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b9441d93-d699-447b-83c3-6b9b89629368 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.175123 Jul 30 16:11:55.262692 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 406/824] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:55 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:11:55.884919 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-35b92831-a8c6-4108-8642-b5f65a20b1b1 req-9ec7e766-ffff-4e87-8216-07212fe64eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f429942e-bf01-4d55-9cb0-29cdf5d6fef6", "name": "network-vif-deleted", "tag": "4f9fcb96-116b-472f-84aa-c777e2358cb4"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:11:55.886514 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:11:55.886514 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:11:55.893717 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-35b92831-a8c6-4108-8642-b5f65a20b1b1 req-9ec7e766-ffff-4e87-8216-07212fe64eaf service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:55.894157 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-35b92831-a8c6-4108-8642-b5f65a20b1b1 req-9ec7e766-ffff-4e87-8216-07212fe64eaf service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:55.905383 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-35b92831-a8c6-4108-8642-b5f65a20b1b1 req-9ec7e766-ffff-4e87-8216-07212fe64eaf service nova] Creating event network-vif-deleted:4f9fcb96-116b-472f-84aa-c777e2358cb4 for instance f429942e-bf01-4d55-9cb0-29cdf5d6fef6 on hv-cinder-80304 Jul 30 16:11:55.909887 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-35b92831-a8c6-4108-8642-b5f65a20b1b1 req-9ec7e766-ffff-4e87-8216-07212fe64eaf service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028625 Jul 30 16:11:55.910443 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 419/825] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:11:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:11:56.089562 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b113f440-1ff5-4fc7-ba91-34385e336fd9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:56.090063 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b113f440-1ff5-4fc7-ba91-34385e336fd9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:56.096554 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b113f440-1ff5-4fc7-ba91-34385e336fd9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:56.096999 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b113f440-1ff5-4fc7-ba91-34385e336fd9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:56.097756 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b113f440-1ff5-4fc7-ba91-34385e336fd9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:56.098182 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b113f440-1ff5-4fc7-ba91-34385e336fd9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:56.120005 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-319f6f47-02b6-4f86-a152-e3a1e6da70f3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:56.120710 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-319f6f47-02b6-4f86-a152-e3a1e6da70f3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:56.121855 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b113f440-1ff5-4fc7-ba91-34385e336fd9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Going to try to terminate instance {{(pid=107452) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:11:56.126744 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-319f6f47-02b6-4f86-a152-e3a1e6da70f3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:56.127360 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-319f6f47-02b6-4f86-a152-e3a1e6da70f3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:56.128150 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-319f6f47-02b6-4f86-a152-e3a1e6da70f3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:56.128590 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-319f6f47-02b6-4f86-a152-e3a1e6da70f3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:56.190149 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-319f6f47-02b6-4f86-a152-e3a1e6da70f3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:56.197896 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-319f6f47-02b6-4f86-a152-e3a1e6da70f3 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1479 microversion: 2.1 time: 0.082009 Jul 30 16:11:56.198470 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 420/826] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:56 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1479 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:11:56.199467 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b113f440-1ff5-4fc7-ba91-34385e336fd9 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "DELETE /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 204 len: 0 microversion: 2.1 time: 0.113223 Jul 30 16:11:56.200855 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 407/827] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:11:56 2021] DELETE /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 16:11:56.209037 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9db2ef71-fc56-4057-93c1-41bc30f8df5f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:56.209647 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9db2ef71-fc56-4057-93c1-41bc30f8df5f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:56.216118 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9db2ef71-fc56-4057-93c1-41bc30f8df5f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:56.216575 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9db2ef71-fc56-4057-93c1-41bc30f8df5f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:56.217342 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9db2ef71-fc56-4057-93c1-41bc30f8df5f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:56.217776 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9db2ef71-fc56-4057-93c1-41bc30f8df5f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:56.281112 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-cd8d1eaa-ba89-4a7d-8050-8421d89813fd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:56.282139 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-cd8d1eaa-ba89-4a7d-8050-8421d89813fd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:56.287855 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cd8d1eaa-ba89-4a7d-8050-8421d89813fd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:56.288295 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cd8d1eaa-ba89-4a7d-8050-8421d89813fd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:56.289062 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cd8d1eaa-ba89-4a7d-8050-8421d89813fd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:56.289486 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cd8d1eaa-ba89-4a7d-8050-8421d89813fd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:56.341571 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9db2ef71-fc56-4057-93c1-41bc30f8df5f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:56.348932 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9db2ef71-fc56-4057-93c1-41bc30f8df5f tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1514 microversion: 2.1 time: 0.143625 Jul 30 16:11:56.349498 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 421/828] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:56 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:56.413387 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-cd8d1eaa-ba89-4a7d-8050-8421d89813fd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:56.421702 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-cd8d1eaa-ba89-4a7d-8050-8421d89813fd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:56.423233 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-cd8d1eaa-ba89-4a7d-8050-8421d89813fd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:56.424368 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-cd8d1eaa-ba89-4a7d-8050-8421d89813fd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.148107 Jul 30 16:11:56.424922 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 408/829] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:56 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:11:57.216579 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f721fb15-7f30-4565-adf4-5fbadb3ca568 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:57.217501 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f721fb15-7f30-4565-adf4-5fbadb3ca568 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:57.223564 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f721fb15-7f30-4565-adf4-5fbadb3ca568 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:57.224014 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f721fb15-7f30-4565-adf4-5fbadb3ca568 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:57.224781 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f721fb15-7f30-4565-adf4-5fbadb3ca568 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:57.225214 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f721fb15-7f30-4565-adf4-5fbadb3ca568 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:57.284463 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f721fb15-7f30-4565-adf4-5fbadb3ca568 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:57.291925 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f721fb15-7f30-4565-adf4-5fbadb3ca568 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1306 microversion: 2.1 time: 0.079823 Jul 30 16:11:57.292483 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 422/830] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:57 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1306 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:57.366001 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-af3a21a3-4bc3-4661-87b0-0d178f325bd8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:57.366608 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-af3a21a3-4bc3-4661-87b0-0d178f325bd8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:57.372411 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-af3a21a3-4bc3-4661-87b0-0d178f325bd8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:57.372854 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-af3a21a3-4bc3-4661-87b0-0d178f325bd8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:57.373619 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-af3a21a3-4bc3-4661-87b0-0d178f325bd8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:57.374054 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-af3a21a3-4bc3-4661-87b0-0d178f325bd8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:57.443096 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-7db820b8-d8ab-4d60-b640-d3cc76d13fa1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:57.443751 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-7db820b8-d8ab-4d60-b640-d3cc76d13fa1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:57.449441 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7db820b8-d8ab-4d60-b640-d3cc76d13fa1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:57.451517 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7db820b8-d8ab-4d60-b640-d3cc76d13fa1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:57.451517 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7db820b8-d8ab-4d60-b640-d3cc76d13fa1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:57.452292 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7db820b8-d8ab-4d60-b640-d3cc76d13fa1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:57.499467 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-af3a21a3-4bc3-4661-87b0-0d178f325bd8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:57.506725 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-af3a21a3-4bc3-4661-87b0-0d178f325bd8 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1514 microversion: 2.1 time: 0.144300 Jul 30 16:11:57.507312 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 409/831] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:57 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:57.659503 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-7db820b8-d8ab-4d60-b640-d3cc76d13fa1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:57.667585 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-7db820b8-d8ab-4d60-b640-d3cc76d13fa1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:57.669249 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-7db820b8-d8ab-4d60-b640-d3cc76d13fa1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:57.670380 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-7db820b8-d8ab-4d60-b640-d3cc76d13fa1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.231135 Jul 30 16:11:57.670926 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 423/832] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:57 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:11:58.309086 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8574d097-d396-4c6a-bd8d-ea1de81f956e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:58.310243 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8574d097-d396-4c6a-bd8d-ea1de81f956e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:58.316174 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8574d097-d396-4c6a-bd8d-ea1de81f956e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:58.316627 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8574d097-d396-4c6a-bd8d-ea1de81f956e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:58.317391 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8574d097-d396-4c6a-bd8d-ea1de81f956e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:58.317835 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8574d097-d396-4c6a-bd8d-ea1de81f956e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:58.376250 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8574d097-d396-4c6a-bd8d-ea1de81f956e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:58.383439 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8574d097-d396-4c6a-bd8d-ea1de81f956e tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1306 microversion: 2.1 time: 0.078091 Jul 30 16:11:58.383994 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 410/833] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:58 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1306 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:58.523960 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-20a1ca81-9d71-4ec5-8a85-fef7edafcc94 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:58.524623 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-20a1ca81-9d71-4ec5-8a85-fef7edafcc94 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:58.531256 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-20a1ca81-9d71-4ec5-8a85-fef7edafcc94 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:58.531706 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-20a1ca81-9d71-4ec5-8a85-fef7edafcc94 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:58.532471 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-20a1ca81-9d71-4ec5-8a85-fef7edafcc94 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:58.532905 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-20a1ca81-9d71-4ec5-8a85-fef7edafcc94 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:58.584693 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 16:11:58.584913 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: Fri Jul 30 16:11:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 16:11:58.655375 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-20a1ca81-9d71-4ec5-8a85-fef7edafcc94 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:58.662662 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-20a1ca81-9d71-4ec5-8a85-fef7edafcc94 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1514 microversion: 2.1 time: 0.142371 Jul 30 16:11:58.663228 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 424/834] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:58 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1514 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:58.688790 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6025dd62-0d7e-4c67-bc76-767c27465de4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:58.689392 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6025dd62-0d7e-4c67-bc76-767c27465de4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:58.695562 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6025dd62-0d7e-4c67-bc76-767c27465de4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:58.696004 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6025dd62-0d7e-4c67-bc76-767c27465de4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:58.696753 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6025dd62-0d7e-4c67-bc76-767c27465de4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:58.697182 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6025dd62-0d7e-4c67-bc76-767c27465de4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:58.820319 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6025dd62-0d7e-4c67-bc76-767c27465de4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:58.829368 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6025dd62-0d7e-4c67-bc76-767c27465de4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:58.830869 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6025dd62-0d7e-4c67-bc76-767c27465de4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:58.832045 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6025dd62-0d7e-4c67-bc76-767c27465de4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.147019 Jul 30 16:11:58.832607 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 411/835] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:58 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:11:59.400419 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f5373b0d-e4ea-451a-b3a5-fd425224dc7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:59.400866 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f5373b0d-e4ea-451a-b3a5-fd425224dc7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:59.407399 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f5373b0d-e4ea-451a-b3a5-fd425224dc7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:59.407851 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f5373b0d-e4ea-451a-b3a5-fd425224dc7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:59.408618 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f5373b0d-e4ea-451a-b3a5-fd425224dc7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:59.409052 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f5373b0d-e4ea-451a-b3a5-fd425224dc7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:59.467776 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f5373b0d-e4ea-451a-b3a5-fd425224dc7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:59.474989 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f5373b0d-e4ea-451a-b3a5-fd425224dc7d tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1306 microversion: 2.1 time: 0.078428 Jul 30 16:11:59.475571 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 425/836] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:59 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1306 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:59.679363 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ebdd4e1f-174b-4358-a3bf-26ee877adfe7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:59.679898 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ebdd4e1f-174b-4358-a3bf-26ee877adfe7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:59.685670 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ebdd4e1f-174b-4358-a3bf-26ee877adfe7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:59.686112 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ebdd4e1f-174b-4358-a3bf-26ee877adfe7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:59.686863 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ebdd4e1f-174b-4358-a3bf-26ee877adfe7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:59.687345 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ebdd4e1f-174b-4358-a3bf-26ee877adfe7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:59.804219 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-ebdd4e1f-174b-4358-a3bf-26ee877adfe7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:59.811359 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ebdd4e1f-174b-4358-a3bf-26ee877adfe7 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1514 microversion: 2.1 time: 0.135790 Jul 30 16:11:59.811924 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 412/837] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:11:59 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1514 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:11:59.850001 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-87572d89-0b81-45b6-b3d1-b667a15de8bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:11:59.850613 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-87572d89-0b81-45b6-b3d1-b667a15de8bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:11:59.856573 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-87572d89-0b81-45b6-b3d1-b667a15de8bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:59.857018 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-87572d89-0b81-45b6-b3d1-b667a15de8bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:59.857783 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-87572d89-0b81-45b6-b3d1-b667a15de8bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:11:59.858221 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-87572d89-0b81-45b6-b3d1-b667a15de8bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:11:59.975868 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-87572d89-0b81-45b6-b3d1-b667a15de8bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:59.984288 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-87572d89-0b81-45b6-b3d1-b667a15de8bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:59.985772 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-87572d89-0b81-45b6-b3d1-b667a15de8bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:11:59.986893 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-87572d89-0b81-45b6-b3d1-b667a15de8bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.140759 Jul 30 16:11:59.987483 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 426/838] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:11:59 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:12:00.351481 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-2411da8a-ea10-4fee-868d-e7c6079815e8 req-08fce59d-d567-4ecb-b152-9279faa5921a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb", "name": "network-vif-plugged", "status": "completed", "tag": "9138d528-69f5-4703-ba07-6f85b67dc617"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:12:00.353124 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:12:00.353124 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:12:00.360102 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-2411da8a-ea10-4fee-868d-e7c6079815e8 req-08fce59d-d567-4ecb-b152-9279faa5921a service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:00.360549 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-2411da8a-ea10-4fee-868d-e7c6079815e8 req-08fce59d-d567-4ecb-b152-9279faa5921a service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:00.372167 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-2411da8a-ea10-4fee-868d-e7c6079815e8 req-08fce59d-d567-4ecb-b152-9279faa5921a service nova] Creating event network-vif-plugged:9138d528-69f5-4703-ba07-6f85b67dc617 for instance ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb on hv-cinder-80304 Jul 30 16:12:00.376831 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-2411da8a-ea10-4fee-868d-e7c6079815e8 req-08fce59d-d567-4ecb-b152-9279faa5921a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028996 Jul 30 16:12:00.377410 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 413/839] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:12:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:12:00.590463 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b77c79f8-1f16-44e5-98d9-6b4dfe128e5b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:00.591224 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b77c79f8-1f16-44e5-98d9-6b4dfe128e5b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:00.597393 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b77c79f8-1f16-44e5-98d9-6b4dfe128e5b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:00.597983 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b77c79f8-1f16-44e5-98d9-6b4dfe128e5b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:00.598912 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b77c79f8-1f16-44e5-98d9-6b4dfe128e5b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:00.599476 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b77c79f8-1f16-44e5-98d9-6b4dfe128e5b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:00.629570 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b77c79f8-1f16-44e5-98d9-6b4dfe128e5b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:00.630010 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b77c79f8-1f16-44e5-98d9-6b4dfe128e5b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:00.630449 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.objects.instance [None req-b77c79f8-1f16-44e5-98d9-6b4dfe128e5b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lazy-loading 'fault' on Instance uuid f429942e-bf01-4d55-9cb0-29cdf5d6fef6 {{(pid=107453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:12:00.668918 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b77c79f8-1f16-44e5-98d9-6b4dfe128e5b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6bef9b03c4c74b3a0760a0fa219fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827ef52c141425d86e34941944a68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:00.676243 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b77c79f8-1f16-44e5-98d9-6b4dfe128e5b tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 200 len: 1311 microversion: 2.1 time: 0.188102 Jul 30 16:12:00.676795 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 427/840] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:00 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 1311 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:00.827928 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-5c64f89d-7ad2-4329-bdd9-be828cd75d1d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:00.828548 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-5c64f89d-7ad2-4329-bdd9-be828cd75d1d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:00.834449 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5c64f89d-7ad2-4329-bdd9-be828cd75d1d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:00.834900 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5c64f89d-7ad2-4329-bdd9-be828cd75d1d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:00.835706 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5c64f89d-7ad2-4329-bdd9-be828cd75d1d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:00.836141 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5c64f89d-7ad2-4329-bdd9-be828cd75d1d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:00.975890 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-5c64f89d-7ad2-4329-bdd9-be828cd75d1d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:00.990748 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-5c64f89d-7ad2-4329-bdd9-be828cd75d1d tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1514 microversion: 2.1 time: 0.166781 Jul 30 16:12:01.000051 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 414/841] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:00 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:12:01.003900 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d825d560-7f75-4047-a0ee-a7a93a3587cd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:01.004534 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d825d560-7f75-4047-a0ee-a7a93a3587cd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:01.010409 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d825d560-7f75-4047-a0ee-a7a93a3587cd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:01.010860 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d825d560-7f75-4047-a0ee-a7a93a3587cd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:01.011667 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d825d560-7f75-4047-a0ee-a7a93a3587cd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:01.012195 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d825d560-7f75-4047-a0ee-a7a93a3587cd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:01.137050 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d825d560-7f75-4047-a0ee-a7a93a3587cd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:01.145928 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d825d560-7f75-4047-a0ee-a7a93a3587cd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:01.147474 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d825d560-7f75-4047-a0ee-a7a93a3587cd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:01.148639 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d825d560-7f75-4047-a0ee-a7a93a3587cd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.148557 Jul 30 16:12:01.149343 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 428/842] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:12:00 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:12:01.692613 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a74dc5ba-8045-4424-a310-3a68d9027fb0 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:01.693218 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a74dc5ba-8045-4424-a310-3a68d9027fb0 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] [instance: f429942e-bf01-4d55-9cb0-29cdf5d6fef6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:01.698943 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a74dc5ba-8045-4424-a310-3a68d9027fb0 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:01.700267 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a74dc5ba-8045-4424-a310-3a68d9027fb0 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:01.701015 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a74dc5ba-8045-4424-a310-3a68d9027fb0 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:01.701448 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a74dc5ba-8045-4424-a310-3a68d9027fb0 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:01.714230 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-a74dc5ba-8045-4424-a310-3a68d9027fb0 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] HTTP exception thrown: Instance f429942e-bf01-4d55-9cb0-29cdf5d6fef6 could not be found. Jul 30 16:12:01.714806 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a74dc5ba-8045-4424-a310-3a68d9027fb0 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] Returning 404 to user: Instance f429942e-bf01-4d55-9cb0-29cdf5d6fef6 could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:12:01.715802 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a74dc5ba-8045-4424-a310-3a68d9027fb0 tempest-ServerRescueNegativeTestJSON-387798038 tempest-ServerRescueNegativeTestJSON-387798038-project] 10.222.0.37 "GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6" status: 404 len: 111 microversion: 2.1 time: 0.027090 Jul 30 16:12:01.716312 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 415/843] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:01 2021] GET /compute/v2.1/servers/f429942e-bf01-4d55-9cb0-29cdf5d6fef6 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:12:02.007681 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-5a1f145b-be28-4142-aaf9-df59db5e5cf0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:02.008269 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-5a1f145b-be28-4142-aaf9-df59db5e5cf0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:02.014565 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5a1f145b-be28-4142-aaf9-df59db5e5cf0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:02.015019 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5a1f145b-be28-4142-aaf9-df59db5e5cf0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:02.015832 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5a1f145b-be28-4142-aaf9-df59db5e5cf0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:02.016271 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5a1f145b-be28-4142-aaf9-df59db5e5cf0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:02.167480 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6ec39351-fa5d-49e0-9dd2-7e976b4a4c51 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:02.168214 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6ec39351-fa5d-49e0-9dd2-7e976b4a4c51 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:02.174926 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6ec39351-fa5d-49e0-9dd2-7e976b4a4c51 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:02.175502 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6ec39351-fa5d-49e0-9dd2-7e976b4a4c51 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:02.176364 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6ec39351-fa5d-49e0-9dd2-7e976b4a4c51 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:02.176899 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6ec39351-fa5d-49e0-9dd2-7e976b4a4c51 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:02.311469 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6ec39351-fa5d-49e0-9dd2-7e976b4a4c51 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:02.319730 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6ec39351-fa5d-49e0-9dd2-7e976b4a4c51 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:02.321232 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6ec39351-fa5d-49e0-9dd2-7e976b4a4c51 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:02.322369 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6ec39351-fa5d-49e0-9dd2-7e976b4a4c51 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.158631 Jul 30 16:12:02.322918 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 416/844] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:12:02 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:12:02.410296 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-5a1f145b-be28-4142-aaf9-df59db5e5cf0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:02.417723 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-5a1f145b-be28-4142-aaf9-df59db5e5cf0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1514 microversion: 2.1 time: 0.413866 Jul 30 16:12:02.418382 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 429/845] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:02 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1514 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:03.218710 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-88aa6589-d9a2-42c1-b7bb-50932e6c2418 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:12:03.219683 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-88aa6589-d9a2-42c1-b7bb-50932e6c2418 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:03.225995 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-88aa6589-d9a2-42c1-b7bb-50932e6c2418 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:03.226446 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-88aa6589-d9a2-42c1-b7bb-50932e6c2418 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:03.227237 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-88aa6589-d9a2-42c1-b7bb-50932e6c2418 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:03.227677 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-88aa6589-d9a2-42c1-b7bb-50932e6c2418 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:03.304879 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-88aa6589-d9a2-42c1-b7bb-50932e6c2418 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "POST /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/action" status: 202 len: 0 microversion: 2.1 time: 0.090232 Jul 30 16:12:03.308409 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 417/846] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:12:03 2021] POST /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:12:03.314037 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-edb12210-7f7c-4b92-bbd7-bb81f3556b5e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:03.314653 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-edb12210-7f7c-4b92-bbd7-bb81f3556b5e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:03.320426 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-edb12210-7f7c-4b92-bbd7-bb81f3556b5e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:03.320874 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-edb12210-7f7c-4b92-bbd7-bb81f3556b5e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:03.321632 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-edb12210-7f7c-4b92-bbd7-bb81f3556b5e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:03.322060 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-edb12210-7f7c-4b92-bbd7-bb81f3556b5e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:03.341809 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-2589ae0c-9a6d-4731-9c42-3ea8393c69d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:03.342499 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-2589ae0c-9a6d-4731-9c42-3ea8393c69d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:03.348581 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2589ae0c-9a6d-4731-9c42-3ea8393c69d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:03.349026 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2589ae0c-9a6d-4731-9c42-3ea8393c69d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:03.349784 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2589ae0c-9a6d-4731-9c42-3ea8393c69d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:03.350211 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2589ae0c-9a6d-4731-9c42-3ea8393c69d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:03.474148 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-2589ae0c-9a6d-4731-9c42-3ea8393c69d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:03.482685 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-2589ae0c-9a6d-4731-9c42-3ea8393c69d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:03.484214 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-2589ae0c-9a6d-4731-9c42-3ea8393c69d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:03.485407 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-2589ae0c-9a6d-4731-9c42-3ea8393c69d1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.148454 Jul 30 16:12:03.485969 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 418/847] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:12:03 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:12:03.490273 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-4ce98f2f-70c2-437d-b7f1-845f5613c13c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:03.490873 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-4ce98f2f-70c2-437d-b7f1-845f5613c13c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:03.496570 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4ce98f2f-70c2-437d-b7f1-845f5613c13c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:03.497053 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4ce98f2f-70c2-437d-b7f1-845f5613c13c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:03.497873 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4ce98f2f-70c2-437d-b7f1-845f5613c13c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:03.498314 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4ce98f2f-70c2-437d-b7f1-845f5613c13c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:03.543742 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-edb12210-7f7c-4b92-bbd7-bb81f3556b5e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:03.553097 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-edb12210-7f7c-4b92-bbd7-bb81f3556b5e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1751 microversion: 2.1 time: 0.242680 Jul 30 16:12:03.553672 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 430/848] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:03 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1751 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:03.625006 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-4ce98f2f-70c2-437d-b7f1-845f5613c13c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:03.632283 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-4ce98f2f-70c2-437d-b7f1-845f5613c13c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1514 microversion: 2.1 time: 0.145369 Jul 30 16:12:03.632975 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 419/849] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:03 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:04.503924 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a3db2469-30db-47bf-a39e-2828f5f71a1d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:04.504535 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a3db2469-30db-47bf-a39e-2828f5f71a1d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:04.510647 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a3db2469-30db-47bf-a39e-2828f5f71a1d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:04.511167 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a3db2469-30db-47bf-a39e-2828f5f71a1d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:04.511945 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a3db2469-30db-47bf-a39e-2828f5f71a1d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:04.513040 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a3db2469-30db-47bf-a39e-2828f5f71a1d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:04.570609 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-084807ea-a18f-4194-b19a-0b309c9e652c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:04.572130 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-084807ea-a18f-4194-b19a-0b309c9e652c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:04.578767 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-084807ea-a18f-4194-b19a-0b309c9e652c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:04.579257 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-084807ea-a18f-4194-b19a-0b309c9e652c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:04.580050 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-084807ea-a18f-4194-b19a-0b309c9e652c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:04.580485 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-084807ea-a18f-4194-b19a-0b309c9e652c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:04.645712 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a3db2469-30db-47bf-a39e-2828f5f71a1d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:04.656032 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a3db2469-30db-47bf-a39e-2828f5f71a1d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:04.657569 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a3db2469-30db-47bf-a39e-2828f5f71a1d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:04.658892 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a3db2469-30db-47bf-a39e-2828f5f71a1d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.159171 Jul 30 16:12:04.659498 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 431/850] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:12:04 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:12:04.664437 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-7d019b4c-096b-40ea-9f81-3207d581034a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:04.665284 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-7d019b4c-096b-40ea-9f81-3207d581034a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:04.672285 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7d019b4c-096b-40ea-9f81-3207d581034a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:04.673136 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7d019b4c-096b-40ea-9f81-3207d581034a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:04.674829 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7d019b4c-096b-40ea-9f81-3207d581034a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:04.675964 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7d019b4c-096b-40ea-9f81-3207d581034a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:04.761305 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-084807ea-a18f-4194-b19a-0b309c9e652c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:04.778560 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-084807ea-a18f-4194-b19a-0b309c9e652c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1751 microversion: 2.1 time: 0.211632 Jul 30 16:12:04.779515 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 420/851] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:04 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1751 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:12:04.852052 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-7d019b4c-096b-40ea-9f81-3207d581034a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:04.859655 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-7d019b4c-096b-40ea-9f81-3207d581034a tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1514 microversion: 2.1 time: 0.198850 Jul 30 16:12:04.860223 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 432/852] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:04 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:05.676651 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e9d185c8-ca91-42ab-9333-3546125d2cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:05.677259 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e9d185c8-ca91-42ab-9333-3546125d2cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:05.683574 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e9d185c8-ca91-42ab-9333-3546125d2cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:05.684526 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e9d185c8-ca91-42ab-9333-3546125d2cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:05.685672 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e9d185c8-ca91-42ab-9333-3546125d2cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:05.686281 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e9d185c8-ca91-42ab-9333-3546125d2cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:05.796069 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-79acd1f0-9561-4b6e-b7a2-5c8aafd01497 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:05.796670 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-79acd1f0-9561-4b6e-b7a2-5c8aafd01497 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:05.809554 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-79acd1f0-9561-4b6e-b7a2-5c8aafd01497 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:05.810100 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-79acd1f0-9561-4b6e-b7a2-5c8aafd01497 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:05.810891 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-79acd1f0-9561-4b6e-b7a2-5c8aafd01497 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:05.811531 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-79acd1f0-9561-4b6e-b7a2-5c8aafd01497 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:05.937079 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e9d185c8-ca91-42ab-9333-3546125d2cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:05.947525 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e9d185c8-ca91-42ab-9333-3546125d2cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:05.949307 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e9d185c8-ca91-42ab-9333-3546125d2cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:05.951372 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e9d185c8-ca91-42ab-9333-3546125d2cb3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1807 microversion: 2.20 time: 0.278771 Jul 30 16:12:05.962891 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 421/853] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:12:05 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1807 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:12:05.969062 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0ad1a157-b53f-4475-9309-750863969db0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:05.970125 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0ad1a157-b53f-4475-9309-750863969db0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:05.976365 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0ad1a157-b53f-4475-9309-750863969db0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:05.976817 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0ad1a157-b53f-4475-9309-750863969db0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:05.977607 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0ad1a157-b53f-4475-9309-750863969db0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:05.978043 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0ad1a157-b53f-4475-9309-750863969db0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:06.010493 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-79acd1f0-9561-4b6e-b7a2-5c8aafd01497 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:06.024364 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-79acd1f0-9561-4b6e-b7a2-5c8aafd01497 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1751 microversion: 2.1 time: 0.231405 Jul 30 16:12:06.029026 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 433/854] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:05 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1751 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:06.201301 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0ad1a157-b53f-4475-9309-750863969db0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:06.211906 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0ad1a157-b53f-4475-9309-750863969db0 tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1514 microversion: 2.1 time: 0.247485 Jul 30 16:12:06.213889 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 422/855] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:05 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1514 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:06.616281 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-c139101f-b721-4949-8819-f5aec35157d1 req-3c9a4b48-7470-4a68-9970-90ee3f8410d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "babe3fe6-376a-4331-8d5d-c2dd904a9fa2", "name": "network-vif-deleted", "tag": "145bce74-4c4f-477e-a0d9-380929929e79"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:12:06.618135 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:12:06.618135 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:12:06.625967 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-c139101f-b721-4949-8819-f5aec35157d1 req-3c9a4b48-7470-4a68-9970-90ee3f8410d8 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:06.626408 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-c139101f-b721-4949-8819-f5aec35157d1 req-3c9a4b48-7470-4a68-9970-90ee3f8410d8 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:06.627935 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-5ff82f92-777d-4abe-b338-23b36e52e555 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Action: 'create', calling method: .version_select at 0x7fb17ea2d8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-208820585"}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:12:06.640897 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-c139101f-b721-4949-8819-f5aec35157d1 req-3c9a4b48-7470-4a68-9970-90ee3f8410d8 service nova] Creating event network-vif-deleted:145bce74-4c4f-477e-a0d9-380929929e79 for instance babe3fe6-376a-4331-8d5d-c2dd904a9fa2 on hv-cinder-80304 Jul 30 16:12:06.646198 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-c139101f-b721-4949-8819-f5aec35157d1 req-3c9a4b48-7470-4a68-9970-90ee3f8410d8 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033602 Jul 30 16:12:06.647488 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 423/856] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:12:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:12:06.933985 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-5ff82f92-777d-4abe-b338-23b36e52e555 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.457603 Jul 30 16:12:06.934753 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 434/857] 10.222.0.37 () {60 vars in 1155 bytes} [Fri Jul 30 16:12:06 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 459 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 30 16:12:06.945839 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-20768b9e-f9ab-49c5-8799-67877b75bcd8 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Calling method '.version_select at 0x7fb17eaed4c0>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:06.971965 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3d4d5e48-2c98-46f2-a1c8-814f83d48179 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:06.972960 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-3d4d5e48-2c98-46f2-a1c8-814f83d48179 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:06.980145 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3d4d5e48-2c98-46f2-a1c8-814f83d48179 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:06.980933 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3d4d5e48-2c98-46f2-a1c8-814f83d48179 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:06.981987 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3d4d5e48-2c98-46f2-a1c8-814f83d48179 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:06.982493 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3d4d5e48-2c98-46f2-a1c8-814f83d48179 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:07.000027 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-20768b9e-f9ab-49c5-8799-67877b75bcd8 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/917c9235-108f-45a9-b5a1-6bbfa8c7cff0" status: 200 len: 344 microversion: 2.1 time: 0.058074 Jul 30 16:12:07.000615 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 424/858] 10.222.0.37 () {58 vars in 1245 bytes} [Fri Jul 30 16:12:06 2021] GET /compute/v2.1/os-volumes/917c9235-108f-45a9-b5a1-6bbfa8c7cff0 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:12:07.042525 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-16e3a479-e815-4ea3-94d4-b495e004d6cb tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:07.043778 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-16e3a479-e815-4ea3-94d4-b495e004d6cb tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:07.049964 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-16e3a479-e815-4ea3-94d4-b495e004d6cb tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:07.050408 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-16e3a479-e815-4ea3-94d4-b495e004d6cb tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:07.051407 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-16e3a479-e815-4ea3-94d4-b495e004d6cb tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:07.051840 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-16e3a479-e815-4ea3-94d4-b495e004d6cb tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:07.115325 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3d4d5e48-2c98-46f2-a1c8-814f83d48179 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:07.125108 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3d4d5e48-2c98-46f2-a1c8-814f83d48179 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:07.126598 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3d4d5e48-2c98-46f2-a1c8-814f83d48179 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:07.127768 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-3d4d5e48-2c98-46f2-a1c8-814f83d48179 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1794 microversion: 2.20 time: 0.160521 Jul 30 16:12:07.128321 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 435/859] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:12:06 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1794 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:12:07.182227 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-16e3a479-e815-4ea3-94d4-b495e004d6cb tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:07.190672 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-16e3a479-e815-4ea3-94d4-b495e004d6cb tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.152314 Jul 30 16:12:07.191261 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 425/860] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:07 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:12:07.229647 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-35349a0c-c516-4eef-9c78-784596ca157b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:07.230242 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-35349a0c-c516-4eef-9c78-784596ca157b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:07.236623 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-35349a0c-c516-4eef-9c78-784596ca157b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:07.237069 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-35349a0c-c516-4eef-9c78-784596ca157b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:07.237826 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-35349a0c-c516-4eef-9c78-784596ca157b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:07.238322 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-35349a0c-c516-4eef-9c78-784596ca157b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:07.269607 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-35349a0c-c516-4eef-9c78-784596ca157b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:07.270050 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-35349a0c-c516-4eef-9c78-784596ca157b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:07.270564 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.objects.instance [None req-35349a0c-c516-4eef-9c78-784596ca157b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lazy-loading 'fault' on Instance uuid babe3fe6-376a-4331-8d5d-c2dd904a9fa2 {{(pid=107453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:12:07.535504 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-35349a0c-c516-4eef-9c78-784596ca157b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f16217b495748478088d59006761959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b01b7e6d90426088cefd5ff16e7347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:07.542164 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-35349a0c-c516-4eef-9c78-784596ca157b tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 200 len: 1307 microversion: 2.1 time: 0.316316 Jul 30 16:12:07.542718 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 436/861] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:07 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 1307 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:08.012868 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-66d877cf-8ff5-4353-87cc-0e3603edf9ab tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Calling method '.version_select at 0x7fb17ecb74c0>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:08.063998 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-66d877cf-8ff5-4353-87cc-0e3603edf9ab tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/917c9235-108f-45a9-b5a1-6bbfa8c7cff0" status: 200 len: 345 microversion: 2.1 time: 0.055186 Jul 30 16:12:08.064571 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 426/862] 10.222.0.37 () {58 vars in 1245 bytes} [Fri Jul 30 16:12:08 2021] GET /compute/v2.1/os-volumes/917c9235-108f-45a9-b5a1-6bbfa8c7cff0 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:12:08.075947 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2f2b966a-b283-414d-a3bd-8030993778d8 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Action: 'create', calling method: .version_select at 0x7fb17ea758b0>, body: {"snapshot": {"volume_id": "917c9235-108f-45a9-b5a1-6bbfa8c7cff0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1193963555"}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:12:08.208038 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-273a7947-afa9-469e-9c12-b4c6e87937b8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:08.208757 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-273a7947-afa9-469e-9c12-b4c6e87937b8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:08.214538 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2f2b966a-b283-414d-a3bd-8030993778d8 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.142637 Jul 30 16:12:08.216067 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 437/863] 10.222.0.37 () {60 vars in 1162 bytes} [Fri Jul 30 16:12:08 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:12:08.220257 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-273a7947-afa9-469e-9c12-b4c6e87937b8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:08.225608 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-eb616acf-086a-4882-ac8c-7a94cca709d7 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Calling method '.version_select at 0x7fb17ea154c0>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:08.231265 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-273a7947-afa9-469e-9c12-b4c6e87937b8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:08.232168 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-273a7947-afa9-469e-9c12-b4c6e87937b8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:08.232611 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-273a7947-afa9-469e-9c12-b4c6e87937b8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:08.260062 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-eb616acf-086a-4882-ac8c-7a94cca709d7 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363" status: 200 len: 287 microversion: 2.1 time: 0.038004 Jul 30 16:12:08.260610 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 438/864] 10.222.0.37 () {58 vars in 1251 bytes} [Fri Jul 30 16:12:08 2021] GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:12:08.271192 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3495f3e7-c0ac-4b0c-a6b4-6984efe1a6dc tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Calling method '.version_select at 0x7fb17e9c6c10>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:08.300817 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-3495f3e7-c0ac-4b0c-a6b4-6984efe1a6dc tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033299 Jul 30 16:12:08.301383 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 439/865] 10.222.0.37 () {58 vars in 1140 bytes} [Fri Jul 30 16:12:08 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:12:08.311557 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-7258066d-831c-497d-b21f-b8fb2237b21e tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Calling method '.version_select at 0x7fb17ebc99d0>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:08.340410 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-7258066d-831c-497d-b21f-b8fb2237b21e tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363" status: 200 len: 287 microversion: 2.1 time: 0.032854 Jul 30 16:12:08.341074 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 440/866] 10.222.0.37 () {58 vars in 1251 bytes} [Fri Jul 30 16:12:08 2021] GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:12:08.359770 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-273a7947-afa9-469e-9c12-b4c6e87937b8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:08.367573 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-273a7947-afa9-469e-9c12-b4c6e87937b8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.163257 Jul 30 16:12:08.368132 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 427/867] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:08 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:12:08.559824 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-edec2460-d4ee-41c6-8a22-d945bd04d24c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:08.560357 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-edec2460-d4ee-41c6-8a22-d945bd04d24c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] [instance: babe3fe6-376a-4331-8d5d-c2dd904a9fa2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:08.566289 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-edec2460-d4ee-41c6-8a22-d945bd04d24c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:08.566746 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-edec2460-d4ee-41c6-8a22-d945bd04d24c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:08.567554 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-edec2460-d4ee-41c6-8a22-d945bd04d24c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:08.567997 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-edec2460-d4ee-41c6-8a22-d945bd04d24c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:08.581242 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-edec2460-d4ee-41c6-8a22-d945bd04d24c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] HTTP exception thrown: Instance babe3fe6-376a-4331-8d5d-c2dd904a9fa2 could not be found. Jul 30 16:12:08.581826 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-edec2460-d4ee-41c6-8a22-d945bd04d24c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] Returning 404 to user: Instance babe3fe6-376a-4331-8d5d-c2dd904a9fa2 could not be found. {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:12:08.582638 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-edec2460-d4ee-41c6-8a22-d945bd04d24c tempest-AttachVolumeNegativeTest-1538000330 tempest-AttachVolumeNegativeTest-1538000330-project] 10.222.0.37 "GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2" status: 404 len: 111 microversion: 2.1 time: 0.027204 Jul 30 16:12:08.583175 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 441/868] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:08 2021] GET /compute/v2.1/servers/babe3fe6-376a-4331-8d5d-c2dd904a9fa2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:12:09.059983 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-38997351-dd62-41d1-bc59-20654e2398b0 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:09.060374 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-38997351-dd62-41d1-bc59-20654e2398b0 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:09.068801 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-38997351-dd62-41d1-bc59-20654e2398b0 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:09.069257 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-38997351-dd62-41d1-bc59-20654e2398b0 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:09.070039 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-38997351-dd62-41d1-bc59-20654e2398b0 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:09.070472 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-38997351-dd62-41d1-bc59-20654e2398b0 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:09.156029 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.objects.instance [None req-38997351-dd62-41d1-bc59-20654e2398b0 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lazy-loading 'services' on Instance uuid eefff8e4-fced-4b3a-8f42-a3555e17a203 {{(pid=107452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:12:09.220157 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-38997351-dd62-41d1-bc59-20654e2398b0 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "DELETE /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203/os-volume_attachments/1d056b39-da51-4da9-a986-b540c64000ad" status: 202 len: 0 microversion: 2.1 time: 0.166644 Jul 30 16:12:09.221076 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 428/869] 10.222.0.37 () {58 vars in 1416 bytes} [Fri Jul 30 16:12:09 2021] DELETE /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203/os-volume_attachments/1d056b39-da51-4da9-a986-b540c64000ad => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:12:09.351181 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-344f5437-8eae-4fb6-b406-9f869b472f23 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Calling method '.version_select at 0x7fb17ea2d040>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:09.380493 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-344f5437-8eae-4fb6-b406-9f869b472f23 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363" status: 200 len: 287 microversion: 2.1 time: 0.032870 Jul 30 16:12:09.381059 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 442/870] 10.222.0.37 () {58 vars in 1251 bytes} [Fri Jul 30 16:12:09 2021] GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:12:09.389231 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-30c0c15d-2c9a-4891-95ab-3aaea5b32e83 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:09.389926 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-30c0c15d-2c9a-4891-95ab-3aaea5b32e83 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:09.396120 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-30c0c15d-2c9a-4891-95ab-3aaea5b32e83 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:09.396562 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-30c0c15d-2c9a-4891-95ab-3aaea5b32e83 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:09.397450 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-30c0c15d-2c9a-4891-95ab-3aaea5b32e83 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:09.397887 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-30c0c15d-2c9a-4891-95ab-3aaea5b32e83 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:09.539193 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-30c0c15d-2c9a-4891-95ab-3aaea5b32e83 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:09.547676 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-30c0c15d-2c9a-4891-95ab-3aaea5b32e83 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.162431 Jul 30 16:12:09.548248 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 429/871] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:09 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:12:10.392260 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-43ae7531-3f41-4f15-8849-10a38db88270 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Calling method '.version_select at 0x7fb17e9c6280>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:10.422332 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-43ae7531-3f41-4f15-8849-10a38db88270 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363" status: 200 len: 287 microversion: 2.1 time: 0.033586 Jul 30 16:12:10.422946 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 443/872] 10.222.0.37 () {58 vars in 1251 bytes} [Fri Jul 30 16:12:10 2021] GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:12:10.565201 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-169580da-8d0b-4df6-90eb-7640394a024b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:10.565802 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-169580da-8d0b-4df6-90eb-7640394a024b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:10.571580 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-169580da-8d0b-4df6-90eb-7640394a024b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:10.572035 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-169580da-8d0b-4df6-90eb-7640394a024b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:10.572808 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-169580da-8d0b-4df6-90eb-7640394a024b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:10.573243 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-169580da-8d0b-4df6-90eb-7640394a024b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:10.694708 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-169580da-8d0b-4df6-90eb-7640394a024b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:10.703064 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-169580da-8d0b-4df6-90eb-7640394a024b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.141542 Jul 30 16:12:10.703659 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 430/873] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:10 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:11.433794 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-510ad45f-3b5e-4714-bc84-ba322c4e59c6 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Calling method '.version_select at 0x7fb17ebc99d0>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:11.462051 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-510ad45f-3b5e-4714-bc84-ba322c4e59c6 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363" status: 200 len: 287 microversion: 2.1 time: 0.031870 Jul 30 16:12:11.462663 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 444/874] 10.222.0.37 () {58 vars in 1251 bytes} [Fri Jul 30 16:12:11 2021] GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:12:11.719809 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6bd40743-eac0-42b9-a214-398ae91730f3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:11.720981 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6bd40743-eac0-42b9-a214-398ae91730f3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:11.727389 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6bd40743-eac0-42b9-a214-398ae91730f3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:11.727994 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6bd40743-eac0-42b9-a214-398ae91730f3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:11.728755 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6bd40743-eac0-42b9-a214-398ae91730f3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:11.729186 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6bd40743-eac0-42b9-a214-398ae91730f3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:11.852196 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6bd40743-eac0-42b9-a214-398ae91730f3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:11.859906 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6bd40743-eac0-42b9-a214-398ae91730f3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.143872 Jul 30 16:12:11.860473 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 431/875] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:11 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:12.457258 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-22f01ba8-c9d9-416a-8745-e4754f133f92 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:12.457765 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-22f01ba8-c9d9-416a-8745-e4754f133f92 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:12.463561 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-22f01ba8-c9d9-416a-8745-e4754f133f92 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:12.464004 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-22f01ba8-c9d9-416a-8745-e4754f133f92 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:12.464760 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-22f01ba8-c9d9-416a-8745-e4754f133f92 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:12.465222 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-22f01ba8-c9d9-416a-8745-e4754f133f92 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:12.473665 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f287988f-d2dc-4519-9fed-9d6b5ec2397d tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Calling method '.version_select at 0x7fb17eaf8af0>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:12.490388 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-22f01ba8-c9d9-416a-8745-e4754f133f92 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Going to try to terminate instance {{(pid=107453) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:12:12.503869 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f287988f-d2dc-4519-9fed-9d6b5ec2397d tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363" status: 200 len: 288 microversion: 2.1 time: 0.033651 Jul 30 16:12:12.504423 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 432/876] 10.222.0.37 () {58 vars in 1251 bytes} [Fri Jul 30 16:12:12 2021] GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:12:12.513935 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e7043b90-014e-4cd9-b782-716d16cf7310 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Calling method '.version_select at 0x7fb17ea53820>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:12.565170 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-22f01ba8-c9d9-416a-8745-e4754f133f92 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "DELETE /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 204 len: 0 microversion: 2.1 time: 0.110718 Jul 30 16:12:12.566084 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 445/877] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:12:12 2021] DELETE /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 16:12:12.570190 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e7043b90-014e-4cd9-b782-716d16cf7310 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "DELETE /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363" status: 202 len: 0 microversion: 2.1 time: 0.059594 Jul 30 16:12:12.570813 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 433/878] 10.222.0.37 () {58 vars in 1254 bytes} [Fri Jul 30 16:12:12 2021] DELETE /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:12:12.574679 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-47d62e99-aedc-4f66-8086-ed5818b22e7b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:12.575596 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-47d62e99-aedc-4f66-8086-ed5818b22e7b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:12.579060 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-5079bc3c-e27a-4dec-88bb-d4b1cc527fa6 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Calling method '.version_select at 0x7fb17eb251f0>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:12.581440 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-47d62e99-aedc-4f66-8086-ed5818b22e7b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:12.581894 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-47d62e99-aedc-4f66-8086-ed5818b22e7b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:12.582665 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-47d62e99-aedc-4f66-8086-ed5818b22e7b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:12.583098 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-47d62e99-aedc-4f66-8086-ed5818b22e7b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:12.608656 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-5079bc3c-e27a-4dec-88bb-d4b1cc527fa6 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363" status: 200 len: 287 microversion: 2.1 time: 0.033065 Jul 30 16:12:12.609210 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 434/879] 10.222.0.37 () {58 vars in 1251 bytes} [Fri Jul 30 16:12:12 2021] GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:12:12.701966 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-47d62e99-aedc-4f66-8086-ed5818b22e7b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:12.709218 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-47d62e99-aedc-4f66-8086-ed5818b22e7b tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1515 microversion: 2.1 time: 0.138773 Jul 30 16:12:12.709776 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 446/880] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:12 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1515 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:12:12.875958 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-da953c3e-5d8d-4fe1-bad4-a63d2c64b937 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:12.876503 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-da953c3e-5d8d-4fe1-bad4-a63d2c64b937 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:12.883252 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-da953c3e-5d8d-4fe1-bad4-a63d2c64b937 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:12.883700 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-da953c3e-5d8d-4fe1-bad4-a63d2c64b937 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:12.884464 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-da953c3e-5d8d-4fe1-bad4-a63d2c64b937 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:12.884898 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-da953c3e-5d8d-4fe1-bad4-a63d2c64b937 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:13.002486 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-da953c3e-5d8d-4fe1-bad4-a63d2c64b937 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:13.010139 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-da953c3e-5d8d-4fe1-bad4-a63d2c64b937 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.137883 Jul 30 16:12:13.010696 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 435/881] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:12 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:13.620259 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-09660fe3-f9c8-4a4b-9b52-6f7f024465ab tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Calling method '.version_select at 0x7fb17e9c6940>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:13.650168 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-09660fe3-f9c8-4a4b-9b52-6f7f024465ab tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363" status: 200 len: 287 microversion: 2.1 time: 0.033943 Jul 30 16:12:13.650719 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 447/882] 10.222.0.37 () {58 vars in 1251 bytes} [Fri Jul 30 16:12:13 2021] GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:12:13.725869 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-18a4a648-6205-426f-bcdd-c3f49b5153cc tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:13.726506 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-18a4a648-6205-426f-bcdd-c3f49b5153cc tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:13.732329 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-18a4a648-6205-426f-bcdd-c3f49b5153cc tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:13.732776 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-18a4a648-6205-426f-bcdd-c3f49b5153cc tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:13.733540 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-18a4a648-6205-426f-bcdd-c3f49b5153cc tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:13.733969 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-18a4a648-6205-426f-bcdd-c3f49b5153cc tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:13.855757 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-18a4a648-6205-426f-bcdd-c3f49b5153cc tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:13.863011 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-18a4a648-6205-426f-bcdd-c3f49b5153cc tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1515 microversion: 2.1 time: 0.140836 Jul 30 16:12:13.863610 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 436/883] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:13 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1515 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:14.027544 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-53915e1c-3085-4051-8d55-f5bf550b7d92 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:14.028232 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-53915e1c-3085-4051-8d55-f5bf550b7d92 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:14.034382 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-53915e1c-3085-4051-8d55-f5bf550b7d92 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:14.034839 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-53915e1c-3085-4051-8d55-f5bf550b7d92 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:14.035667 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-53915e1c-3085-4051-8d55-f5bf550b7d92 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:14.036075 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-53915e1c-3085-4051-8d55-f5bf550b7d92 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:14.160571 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-53915e1c-3085-4051-8d55-f5bf550b7d92 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:14.168747 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-53915e1c-3085-4051-8d55-f5bf550b7d92 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.144315 Jul 30 16:12:14.169290 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 448/884] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:14 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:14.661572 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f554cfab-3e55-4d7c-91c3-eef6d53d52ce tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Calling method '.version_select at 0x7fb17ea53dc0>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:14.690240 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f554cfab-3e55-4d7c-91c3-eef6d53d52ce tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363" status: 200 len: 287 microversion: 2.1 time: 0.032332 Jul 30 16:12:14.690790 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 437/885] 10.222.0.37 () {58 vars in 1251 bytes} [Fri Jul 30 16:12:14 2021] GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:12:14.879976 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-86a98768-68a5-4ee4-865f-b911be5bf4a8 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:14.880583 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-86a98768-68a5-4ee4-865f-b911be5bf4a8 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:14.886398 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-86a98768-68a5-4ee4-865f-b911be5bf4a8 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:14.886881 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-86a98768-68a5-4ee4-865f-b911be5bf4a8 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:14.887810 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-86a98768-68a5-4ee4-865f-b911be5bf4a8 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:14.888234 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-86a98768-68a5-4ee4-865f-b911be5bf4a8 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:15.016902 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-86a98768-68a5-4ee4-865f-b911be5bf4a8 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:15.024459 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-86a98768-68a5-4ee4-865f-b911be5bf4a8 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1515 microversion: 2.1 time: 0.148093 Jul 30 16:12:15.025027 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 449/886] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:14 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:12:15.185868 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c2c6b98b-17b3-41a2-ae2c-d461d2833504 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:15.186465 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c2c6b98b-17b3-41a2-ae2c-d461d2833504 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:15.192411 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c2c6b98b-17b3-41a2-ae2c-d461d2833504 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:15.192858 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c2c6b98b-17b3-41a2-ae2c-d461d2833504 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:15.193624 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c2c6b98b-17b3-41a2-ae2c-d461d2833504 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:15.194054 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c2c6b98b-17b3-41a2-ae2c-d461d2833504 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:15.320703 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c2c6b98b-17b3-41a2-ae2c-d461d2833504 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:15.329589 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c2c6b98b-17b3-41a2-ae2c-d461d2833504 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.147573 Jul 30 16:12:15.330467 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 438/887] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:15 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:15.702782 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-6e4f8b7b-4ed2-496c-a325-c72bb95f2e76 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Calling method '.version_select at 0x7fb17e96cf70>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:15.729707 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-6e4f8b7b-4ed2-496c-a325-c72bb95f2e76 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] HTTP exception thrown: Snapshot f2d55909-5dcd-4ffb-a935-122fad7c8363 could not be found. Jul 30 16:12:15.730308 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-6e4f8b7b-4ed2-496c-a325-c72bb95f2e76 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Returning 404 to user: Snapshot f2d55909-5dcd-4ffb-a935-122fad7c8363 could not be found. {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:12:15.731200 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-6e4f8b7b-4ed2-496c-a325-c72bb95f2e76 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363" status: 404 len: 111 microversion: 2.1 time: 0.033214 Jul 30 16:12:15.731804 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 450/888] 10.222.0.37 () {58 vars in 1251 bytes} [Fri Jul 30 16:12:15 2021] GET /compute/v2.1/os-snapshots/f2d55909-5dcd-4ffb-a935-122fad7c8363 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:12:15.739759 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1a805c42-f2c6-4d18-ace7-39253f1c5f7c tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Calling method '.version_select at 0x7fb17ea53d30>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:15.797660 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1a805c42-f2c6-4d18-ace7-39253f1c5f7c tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/917c9235-108f-45a9-b5a1-6bbfa8c7cff0" status: 202 len: 0 microversion: 2.1 time: 0.061473 Jul 30 16:12:15.798251 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 439/889] 10.222.0.37 () {58 vars in 1248 bytes} [Fri Jul 30 16:12:15 2021] DELETE /compute/v2.1/os-volumes/917c9235-108f-45a9-b5a1-6bbfa8c7cff0 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:12:15.806371 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ccc78516-091b-46b5-bc10-dbd701cc26b6 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Calling method '.version_select at 0x7fb17ebc99d0>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:15.858563 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ccc78516-091b-46b5-bc10-dbd701cc26b6 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/917c9235-108f-45a9-b5a1-6bbfa8c7cff0" status: 200 len: 344 microversion: 2.1 time: 0.055943 Jul 30 16:12:15.859123 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 451/890] 10.222.0.37 () {58 vars in 1245 bytes} [Fri Jul 30 16:12:15 2021] GET /compute/v2.1/os-volumes/917c9235-108f-45a9-b5a1-6bbfa8c7cff0 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:12:16.042166 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-5e8200e0-65c6-4e4d-b79c-28e27c3e6326 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:16.042781 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-5e8200e0-65c6-4e4d-b79c-28e27c3e6326 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:16.049232 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5e8200e0-65c6-4e4d-b79c-28e27c3e6326 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:16.049679 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5e8200e0-65c6-4e4d-b79c-28e27c3e6326 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:16.050451 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5e8200e0-65c6-4e4d-b79c-28e27c3e6326 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:16.050887 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5e8200e0-65c6-4e4d-b79c-28e27c3e6326 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:16.173606 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-5e8200e0-65c6-4e4d-b79c-28e27c3e6326 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:16.180973 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-5e8200e0-65c6-4e4d-b79c-28e27c3e6326 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1515 microversion: 2.1 time: 0.142835 Jul 30 16:12:16.181577 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 440/891] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:16 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1515 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:16.347840 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-cfd6e314-7788-46c2-ad81-d0d93df9accf tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:16.348475 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-cfd6e314-7788-46c2-ad81-d0d93df9accf tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:16.358102 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cfd6e314-7788-46c2-ad81-d0d93df9accf tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:16.358551 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cfd6e314-7788-46c2-ad81-d0d93df9accf tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:16.359376 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cfd6e314-7788-46c2-ad81-d0d93df9accf tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:16.359802 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cfd6e314-7788-46c2-ad81-d0d93df9accf tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:16.490684 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-cfd6e314-7788-46c2-ad81-d0d93df9accf tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:16.499414 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-cfd6e314-7788-46c2-ad81-d0d93df9accf tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.155373 Jul 30 16:12:16.500052 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 452/892] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:16 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:16.870742 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a09dbc49-408d-4a17-93ca-a87e725cee51 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Calling method '.version_select at 0x7fb17eaed280>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:16.897993 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-a09dbc49-408d-4a17-93ca-a87e725cee51 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] HTTP exception thrown: Volume 917c9235-108f-45a9-b5a1-6bbfa8c7cff0 could not be found. Jul 30 16:12:16.898581 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a09dbc49-408d-4a17-93ca-a87e725cee51 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Returning 404 to user: Volume 917c9235-108f-45a9-b5a1-6bbfa8c7cff0 could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:12:16.899549 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a09dbc49-408d-4a17-93ca-a87e725cee51 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/917c9235-108f-45a9-b5a1-6bbfa8c7cff0" status: 404 len: 109 microversion: 2.1 time: 0.032479 Jul 30 16:12:16.900078 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 441/893] 10.222.0.37 () {58 vars in 1245 bytes} [Fri Jul 30 16:12:16 2021] GET /compute/v2.1/os-volumes/917c9235-108f-45a9-b5a1-6bbfa8c7cff0 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:12:16.909498 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2eef937c-59b8-4f68-8735-59b3638d0a6a tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Calling method '.version_select at 0x7fb17ea75e50>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:16.935690 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-2eef937c-59b8-4f68-8735-59b3638d0a6a tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] HTTP exception thrown: Volume 917c9235-108f-45a9-b5a1-6bbfa8c7cff0 could not be found. Jul 30 16:12:16.936280 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2eef937c-59b8-4f68-8735-59b3638d0a6a tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Returning 404 to user: Volume 917c9235-108f-45a9-b5a1-6bbfa8c7cff0 could not be found. {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:12:16.937087 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2eef937c-59b8-4f68-8735-59b3638d0a6a tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/917c9235-108f-45a9-b5a1-6bbfa8c7cff0" status: 404 len: 109 microversion: 2.1 time: 0.031310 Jul 30 16:12:16.937606 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 453/894] 10.222.0.37 () {58 vars in 1248 bytes} [Fri Jul 30 16:12:16 2021] DELETE /compute/v2.1/os-volumes/917c9235-108f-45a9-b5a1-6bbfa8c7cff0 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:12:16.945100 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-82d56437-e21e-4c24-bd11-60807736b2a2 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Calling method '.version_select at 0x7fb17eaf8af0>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:16.971454 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-82d56437-e21e-4c24-bd11-60807736b2a2 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] HTTP exception thrown: Volume 917c9235-108f-45a9-b5a1-6bbfa8c7cff0 could not be found. Jul 30 16:12:16.972042 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-82d56437-e21e-4c24-bd11-60807736b2a2 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] Returning 404 to user: Volume 917c9235-108f-45a9-b5a1-6bbfa8c7cff0 could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:12:16.972858 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-82d56437-e21e-4c24-bd11-60807736b2a2 tempest-VolumesSnapshotsTestJSON-184866554 tempest-VolumesSnapshotsTestJSON-184866554-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/917c9235-108f-45a9-b5a1-6bbfa8c7cff0" status: 404 len: 109 microversion: 2.1 time: 0.031358 Jul 30 16:12:16.973376 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 442/895] 10.222.0.37 () {58 vars in 1245 bytes} [Fri Jul 30 16:12:16 2021] GET /compute/v2.1/os-volumes/917c9235-108f-45a9-b5a1-6bbfa8c7cff0 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:12:17.199177 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4adec5bc-7b1e-40c4-9211-a99863c3bf60 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:17.199853 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4adec5bc-7b1e-40c4-9211-a99863c3bf60 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:17.206491 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4adec5bc-7b1e-40c4-9211-a99863c3bf60 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:17.206938 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4adec5bc-7b1e-40c4-9211-a99863c3bf60 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:17.207743 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4adec5bc-7b1e-40c4-9211-a99863c3bf60 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:17.208173 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4adec5bc-7b1e-40c4-9211-a99863c3bf60 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:17.352057 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4adec5bc-7b1e-40c4-9211-a99863c3bf60 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:17.359867 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4adec5bc-7b1e-40c4-9211-a99863c3bf60 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1515 microversion: 2.1 time: 0.165823 Jul 30 16:12:17.360420 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 454/896] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:17 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:17.517438 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0200d61f-4d1e-489a-9eb8-5c7fb5c991c1 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:17.518310 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0200d61f-4d1e-489a-9eb8-5c7fb5c991c1 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:17.524066 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0200d61f-4d1e-489a-9eb8-5c7fb5c991c1 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:17.524514 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0200d61f-4d1e-489a-9eb8-5c7fb5c991c1 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:17.525275 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0200d61f-4d1e-489a-9eb8-5c7fb5c991c1 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:17.525701 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0200d61f-4d1e-489a-9eb8-5c7fb5c991c1 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:17.689281 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0200d61f-4d1e-489a-9eb8-5c7fb5c991c1 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:17.699097 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0200d61f-4d1e-489a-9eb8-5c7fb5c991c1 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.185366 Jul 30 16:12:17.699993 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 443/897] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:17 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:18.377140 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-6cd45da8-b946-4ce6-b5b8-3b273df4487e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:18.377766 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-6cd45da8-b946-4ce6-b5b8-3b273df4487e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:18.386953 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6cd45da8-b946-4ce6-b5b8-3b273df4487e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:18.387447 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6cd45da8-b946-4ce6-b5b8-3b273df4487e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:18.388244 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6cd45da8-b946-4ce6-b5b8-3b273df4487e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:18.388683 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6cd45da8-b946-4ce6-b5b8-3b273df4487e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:18.514225 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6cd45da8-b946-4ce6-b5b8-3b273df4487e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:18.521768 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-6cd45da8-b946-4ce6-b5b8-3b273df4487e tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1515 microversion: 2.1 time: 0.148686 Jul 30 16:12:18.522267 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 455/898] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:18 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:18.717216 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8c826d3a-dc3f-4b00-8ef4-3ed426483be3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:18.717822 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8c826d3a-dc3f-4b00-8ef4-3ed426483be3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:18.723768 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8c826d3a-dc3f-4b00-8ef4-3ed426483be3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:18.724217 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8c826d3a-dc3f-4b00-8ef4-3ed426483be3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:18.724987 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8c826d3a-dc3f-4b00-8ef4-3ed426483be3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:18.725426 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8c826d3a-dc3f-4b00-8ef4-3ed426483be3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:18.845630 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8c826d3a-dc3f-4b00-8ef4-3ed426483be3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:18.853359 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8c826d3a-dc3f-4b00-8ef4-3ed426483be3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.140561 Jul 30 16:12:18.853921 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 444/899] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:18 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:19.539407 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e8bbb3c9-1191-47f4-a433-3aba1239909c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:19.540016 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e8bbb3c9-1191-47f4-a433-3aba1239909c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:19.546617 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e8bbb3c9-1191-47f4-a433-3aba1239909c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:19.547011 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e8bbb3c9-1191-47f4-a433-3aba1239909c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:19.547805 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e8bbb3c9-1191-47f4-a433-3aba1239909c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:19.548239 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e8bbb3c9-1191-47f4-a433-3aba1239909c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:19.675444 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e8bbb3c9-1191-47f4-a433-3aba1239909c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:19.683094 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e8bbb3c9-1191-47f4-a433-3aba1239909c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1515 microversion: 2.1 time: 0.147345 Jul 30 16:12:19.683687 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 456/900] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:19 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:19.869911 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0e8a1ef2-7587-44f8-9c4e-bdb07afb3f7d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:19.870459 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0e8a1ef2-7587-44f8-9c4e-bdb07afb3f7d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:19.876752 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0e8a1ef2-7587-44f8-9c4e-bdb07afb3f7d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:19.877201 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0e8a1ef2-7587-44f8-9c4e-bdb07afb3f7d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:19.877975 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0e8a1ef2-7587-44f8-9c4e-bdb07afb3f7d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:19.878412 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0e8a1ef2-7587-44f8-9c4e-bdb07afb3f7d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:19.997850 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0e8a1ef2-7587-44f8-9c4e-bdb07afb3f7d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:20.006207 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0e8a1ef2-7587-44f8-9c4e-bdb07afb3f7d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.139995 Jul 30 16:12:20.006792 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 445/901] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:19 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:20.700403 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9d7022ee-a1ac-41a7-9c79-0228b87ae78a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:20.701017 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9d7022ee-a1ac-41a7-9c79-0228b87ae78a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:20.707365 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9d7022ee-a1ac-41a7-9c79-0228b87ae78a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:20.707820 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9d7022ee-a1ac-41a7-9c79-0228b87ae78a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:20.708608 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9d7022ee-a1ac-41a7-9c79-0228b87ae78a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:20.709042 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9d7022ee-a1ac-41a7-9c79-0228b87ae78a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:20.763950 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0215ef7d-0a6c-4126-b6e5-a45256eb64dc tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] Calling method '.version_select at 0x7fb17ea64670>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:20.839052 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0215ef7d-0a6c-4126-b6e5-a45256eb64dc tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/f148a88e-a4eb-4960-b15c-d39b920e77d9" status: 200 len: 351 microversion: 2.1 time: 0.078081 Jul 30 16:12:20.841349 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 446/902] 10.222.0.37 () {58 vars in 1245 bytes} [Fri Jul 30 16:12:20 2021] GET /compute/v2.1/os-volumes/f148a88e-a4eb-4960-b15c-d39b920e77d9 => generated 351 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:12:20.849342 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9d7022ee-a1ac-41a7-9c79-0228b87ae78a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:20.856644 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9d7022ee-a1ac-41a7-9c79-0228b87ae78a tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1515 microversion: 2.1 time: 0.160162 Jul 30 16:12:20.857222 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 457/903] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:20 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:12:21.023821 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9ccf9d92-7c20-4b67-b7af-25cfba2e15f5 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:21.024462 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9ccf9d92-7c20-4b67-b7af-25cfba2e15f5 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:21.030976 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9ccf9d92-7c20-4b67-b7af-25cfba2e15f5 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:21.031456 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9ccf9d92-7c20-4b67-b7af-25cfba2e15f5 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:21.032482 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9ccf9d92-7c20-4b67-b7af-25cfba2e15f5 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:21.033078 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9ccf9d92-7c20-4b67-b7af-25cfba2e15f5 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:21.243486 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9ccf9d92-7c20-4b67-b7af-25cfba2e15f5 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:21.251874 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9ccf9d92-7c20-4b67-b7af-25cfba2e15f5 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.231684 Jul 30 16:12:21.261565 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 447/904] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:21 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:21.342397 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-0308bbf3-cc2b-401e-80c3-15dfa23e4bd5 req-553a5c0c-ecdf-4f30-b86e-0d10f5d7267b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eefff8e4-fced-4b3a-8f42-a3555e17a203", "name": "network-vif-deleted", "tag": "e2691890-7408-442b-9f7b-d4d100c13d23"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:12:21.344494 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:12:21.344494 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:12:21.354337 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-0308bbf3-cc2b-401e-80c3-15dfa23e4bd5 req-553a5c0c-ecdf-4f30-b86e-0d10f5d7267b service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:21.354589 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-0308bbf3-cc2b-401e-80c3-15dfa23e4bd5 req-553a5c0c-ecdf-4f30-b86e-0d10f5d7267b service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:21.367445 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-0308bbf3-cc2b-401e-80c3-15dfa23e4bd5 req-553a5c0c-ecdf-4f30-b86e-0d10f5d7267b service nova] Creating event network-vif-deleted:e2691890-7408-442b-9f7b-d4d100c13d23 for instance eefff8e4-fced-4b3a-8f42-a3555e17a203 on hv-cinder-80304 Jul 30 16:12:21.374696 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-0308bbf3-cc2b-401e-80c3-15dfa23e4bd5 req-553a5c0c-ecdf-4f30-b86e-0d10f5d7267b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036773 Jul 30 16:12:21.375327 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 458/905] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:12:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:12:21.874237 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d2221802-1481-47c2-9833-1c1eaec67d51 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:21.875046 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d2221802-1481-47c2-9833-1c1eaec67d51 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:21.881615 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d2221802-1481-47c2-9833-1c1eaec67d51 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:21.882138 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d2221802-1481-47c2-9833-1c1eaec67d51 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:21.883063 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d2221802-1481-47c2-9833-1c1eaec67d51 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:21.883609 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d2221802-1481-47c2-9833-1c1eaec67d51 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:21.914066 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d2221802-1481-47c2-9833-1c1eaec67d51 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:21.914531 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d2221802-1481-47c2-9833-1c1eaec67d51 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:21.914976 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.objects.instance [None req-d2221802-1481-47c2-9833-1c1eaec67d51 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lazy-loading 'fault' on Instance uuid eefff8e4-fced-4b3a-8f42-a3555e17a203 {{(pid=107452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:12:21.961325 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d2221802-1481-47c2-9833-1c1eaec67d51 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce25fb105324bd3a8216f224b2251d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bbd6beaee8450d825abd418910d05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:21.968637 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d2221802-1481-47c2-9833-1c1eaec67d51 tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 200 len: 1309 microversion: 2.1 time: 0.098345 Jul 30 16:12:21.969403 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 448/906] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:21 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:22.214305 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e69be9dc-3f05-47aa-a3b0-402d3efb5f19 tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] Calling method '.version_select at 0x7fb17ea2dca0>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:22.269349 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e69be9dc-3f05-47aa-a3b0-402d3efb5f19 tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/81c5d090-1818-4377-bf6b-cea6d2302f52" status: 200 len: 351 microversion: 2.1 time: 0.060573 Jul 30 16:12:22.275509 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 459/907] 10.222.0.37 () {58 vars in 1245 bytes} [Fri Jul 30 16:12:22 2021] GET /compute/v2.1/os-volumes/81c5d090-1818-4377-bf6b-cea6d2302f52 => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:12:22.275680 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b5f3d526-dca9-4c9a-94f0-007ed9d06aaf tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:22.275680 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b5f3d526-dca9-4c9a-94f0-007ed9d06aaf tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:22.278845 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b5f3d526-dca9-4c9a-94f0-007ed9d06aaf tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:22.279334 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b5f3d526-dca9-4c9a-94f0-007ed9d06aaf tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:22.280252 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b5f3d526-dca9-4c9a-94f0-007ed9d06aaf tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:22.280668 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b5f3d526-dca9-4c9a-94f0-007ed9d06aaf tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:22.409250 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b5f3d526-dca9-4c9a-94f0-007ed9d06aaf tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:22.417104 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b5f3d526-dca9-4c9a-94f0-007ed9d06aaf tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.148731 Jul 30 16:12:22.417663 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 449/908] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:22 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:22.986552 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-755e29a7-bb92-4515-a5a9-51e4ba6bf71c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:22.987299 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-755e29a7-bb92-4515-a5a9-51e4ba6bf71c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] [instance: eefff8e4-fced-4b3a-8f42-a3555e17a203] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:22.993357 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-755e29a7-bb92-4515-a5a9-51e4ba6bf71c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:22.993801 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-755e29a7-bb92-4515-a5a9-51e4ba6bf71c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:22.994570 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-755e29a7-bb92-4515-a5a9-51e4ba6bf71c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:22.995000 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-755e29a7-bb92-4515-a5a9-51e4ba6bf71c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:23.008357 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-755e29a7-bb92-4515-a5a9-51e4ba6bf71c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] HTTP exception thrown: Instance eefff8e4-fced-4b3a-8f42-a3555e17a203 could not be found. Jul 30 16:12:23.008935 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-755e29a7-bb92-4515-a5a9-51e4ba6bf71c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] Returning 404 to user: Instance eefff8e4-fced-4b3a-8f42-a3555e17a203 could not be found. {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:12:23.009739 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-755e29a7-bb92-4515-a5a9-51e4ba6bf71c tempest-VolumesSnapshotTestJSON-683084261 tempest-VolumesSnapshotTestJSON-683084261-project] 10.222.0.37 "GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203" status: 404 len: 111 microversion: 2.1 time: 0.026904 Jul 30 16:12:23.010237 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 460/909] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:22 2021] GET /compute/v2.1/servers/eefff8e4-fced-4b3a-8f42-a3555e17a203 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:12:23.434309 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-15c5eac9-9b7d-41c9-acc5-89e3e153310c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:23.434917 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-15c5eac9-9b7d-41c9-acc5-89e3e153310c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:23.440687 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-15c5eac9-9b7d-41c9-acc5-89e3e153310c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:23.441154 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-15c5eac9-9b7d-41c9-acc5-89e3e153310c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:23.441899 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-15c5eac9-9b7d-41c9-acc5-89e3e153310c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:23.442336 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-15c5eac9-9b7d-41c9-acc5-89e3e153310c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:23.563451 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-15c5eac9-9b7d-41c9-acc5-89e3e153310c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:23.571279 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-15c5eac9-9b7d-41c9-acc5-89e3e153310c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.140728 Jul 30 16:12:23.571949 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 450/910] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:23 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:24.588444 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-7fd72242-d22d-4d71-9032-89efad7971eb tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:24.589357 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-7fd72242-d22d-4d71-9032-89efad7971eb tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:24.595091 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7fd72242-d22d-4d71-9032-89efad7971eb tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:24.595574 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7fd72242-d22d-4d71-9032-89efad7971eb tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:24.596352 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7fd72242-d22d-4d71-9032-89efad7971eb tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:24.596792 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-7fd72242-d22d-4d71-9032-89efad7971eb tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:24.731356 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-7fd72242-d22d-4d71-9032-89efad7971eb tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:24.739160 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-7fd72242-d22d-4d71-9032-89efad7971eb tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.154542 Jul 30 16:12:24.739785 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 461/911] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:24 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:25.756815 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-763fea27-de86-4798-9549-385eeeacdd9d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:25.757413 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-763fea27-de86-4798-9549-385eeeacdd9d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:25.763974 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-763fea27-de86-4798-9549-385eeeacdd9d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:25.764417 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-763fea27-de86-4798-9549-385eeeacdd9d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:25.765175 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-763fea27-de86-4798-9549-385eeeacdd9d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:25.765625 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-763fea27-de86-4798-9549-385eeeacdd9d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:25.892207 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-763fea27-de86-4798-9549-385eeeacdd9d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:25.900043 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-763fea27-de86-4798-9549-385eeeacdd9d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.146875 Jul 30 16:12:25.900605 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 451/912] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:25 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:26.751438 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f9cd29fc-1cd3-4c8f-82f9-958193ec5d93 tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] Calling method '.version_select at 0x7fb17ed11d30>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:26.802074 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f9cd29fc-1cd3-4c8f-82f9-958193ec5d93 tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/bc18e377-6a75-4eda-8076-6d0c0dca0d39" status: 200 len: 351 microversion: 2.1 time: 0.056743 Jul 30 16:12:26.802625 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 462/913] 10.222.0.37 () {58 vars in 1245 bytes} [Fri Jul 30 16:12:26 2021] GET /compute/v2.1/os-volumes/bc18e377-6a75-4eda-8076-6d0c0dca0d39 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:12:26.813923 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-31cddd30-454a-4e59-ad78-456d3009e51f tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] Calling method '.version_select at 0x7fb17eaf8ca0>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:26.890653 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-31cddd30-454a-4e59-ad78-456d3009e51f tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] 10.222.0.37 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.080257 Jul 30 16:12:26.891240 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 452/914] 10.222.0.37 () {58 vars in 1134 bytes} [Fri Jul 30 16:12:26 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:26.903161 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-17ebfec7-3664-462a-b195-f9aa7a9b863b tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] Calling method '.version_select at 0x7fb17e96c160>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:26.916507 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-04c6c5af-39b0-4e5c-99cb-04c48239adee tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:26.917118 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-04c6c5af-39b0-4e5c-99cb-04c48239adee tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:26.923994 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-04c6c5af-39b0-4e5c-99cb-04c48239adee tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:26.924444 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-04c6c5af-39b0-4e5c-99cb-04c48239adee tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:26.925216 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-04c6c5af-39b0-4e5c-99cb-04c48239adee tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:26.925653 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-04c6c5af-39b0-4e5c-99cb-04c48239adee tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:26.987396 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-17ebfec7-3664-462a-b195-f9aa7a9b863b tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] 10.222.0.37 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087772 Jul 30 16:12:26.987954 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 463/915] 10.222.0.37 () {58 vars in 1149 bytes} [Fri Jul 30 16:12:26 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:12:26.999695 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f713a05e-477c-41e0-8955-f67bcbf9cef7 tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] Calling method '.version_select at 0x7fb17ea2d550>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:27.050840 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-04c6c5af-39b0-4e5c-99cb-04c48239adee tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:27.058388 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-04c6c5af-39b0-4e5c-99cb-04c48239adee tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.145435 Jul 30 16:12:27.059465 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 453/916] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:26 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:12:27.080223 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f713a05e-477c-41e0-8955-f67bcbf9cef7 tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] 10.222.0.37 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.084510 Jul 30 16:12:27.080780 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 464/917] 10.222.0.37 () {58 vars in 1134 bytes} [Fri Jul 30 16:12:26 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:12:27.091416 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0d11f615-d78d-48ab-86f6-a9289c24a1fd tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] Calling method '.version_select at 0x7fb17ecd3430>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:27.170195 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0d11f615-d78d-48ab-86f6-a9289c24a1fd tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] 10.222.0.37 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082246 Jul 30 16:12:27.170765 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 454/918] 10.222.0.37 () {58 vars in 1167 bytes} [Fri Jul 30 16:12:27 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:12:27.182292 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ff4e2dda-17f5-4c6d-af89-34573231803c tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] Calling method '.version_select at 0x7fb17e9009d0>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:27.264295 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ff4e2dda-17f5-4c6d-af89-34573231803c tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085484 Jul 30 16:12:27.264861 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 465/919] 10.222.0.37 () {58 vars in 1170 bytes} [Fri Jul 30 16:12:27 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:12:27.276612 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-4860bb9b-502f-42c9-a54b-762f77c949d6 tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] Calling method '.version_select at 0x7fb17ea53ca0>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:27.357317 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-4860bb9b-502f-42c9-a54b-762f77c949d6 tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.084201 Jul 30 16:12:27.357883 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 455/920] 10.222.0.37 () {58 vars in 1155 bytes} [Fri Jul 30 16:12:27 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:27.368665 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-82edf9ef-fb45-4893-8f9e-344520be303d tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] Calling method '.version_select at 0x7fb17e96cee0>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:27.604434 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-82edf9ef-fb45-4893-8f9e-344520be303d tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.239269 Jul 30 16:12:27.605079 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 466/921] 10.222.0.37 () {58 vars in 1188 bytes} [Fri Jul 30 16:12:27 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:12:27.617126 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-77ba2086-ead0-49b2-b95b-eacdec62b1f2 tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] Calling method '.version_select at 0x7fb17ea5a310>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:27.719283 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-77ba2086-ead0-49b2-b95b-eacdec62b1f2 tempest-VolumesTestJSON-61111491 tempest-VolumesTestJSON-61111491-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.105926 Jul 30 16:12:27.720030 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 456/922] 10.222.0.37 () {58 vars in 1155 bytes} [Fri Jul 30 16:12:27 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:28.076338 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-943e3332-5434-4fe1-b19c-56adc3ac5ff8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:28.076948 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-943e3332-5434-4fe1-b19c-56adc3ac5ff8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:28.083850 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-943e3332-5434-4fe1-b19c-56adc3ac5ff8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:28.084298 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-943e3332-5434-4fe1-b19c-56adc3ac5ff8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:28.085065 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-943e3332-5434-4fe1-b19c-56adc3ac5ff8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:28.085501 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-943e3332-5434-4fe1-b19c-56adc3ac5ff8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:28.208865 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-943e3332-5434-4fe1-b19c-56adc3ac5ff8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:28.216547 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-943e3332-5434-4fe1-b19c-56adc3ac5ff8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.144091 Jul 30 16:12:28.217098 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 467/923] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:28 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:29.233964 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a1cf8129-688c-4555-b327-cc1df16ec8c3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:29.234568 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a1cf8129-688c-4555-b327-cc1df16ec8c3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:29.240454 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a1cf8129-688c-4555-b327-cc1df16ec8c3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:29.240904 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a1cf8129-688c-4555-b327-cc1df16ec8c3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:29.241668 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a1cf8129-688c-4555-b327-cc1df16ec8c3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:29.242103 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a1cf8129-688c-4555-b327-cc1df16ec8c3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:29.366291 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-a1cf8129-688c-4555-b327-cc1df16ec8c3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:29.374023 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a1cf8129-688c-4555-b327-cc1df16ec8c3 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1756 microversion: 2.1 time: 0.144397 Jul 30 16:12:29.374581 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 457/924] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:29 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1756 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:30.392772 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-473b367c-c7b2-4bd9-a36d-290d52eb17a8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:30.393649 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-473b367c-c7b2-4bd9-a36d-290d52eb17a8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:30.399522 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-473b367c-c7b2-4bd9-a36d-290d52eb17a8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:30.399973 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-473b367c-c7b2-4bd9-a36d-290d52eb17a8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:30.400737 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-473b367c-c7b2-4bd9-a36d-290d52eb17a8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:30.401169 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-473b367c-c7b2-4bd9-a36d-290d52eb17a8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:30.521768 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-473b367c-c7b2-4bd9-a36d-290d52eb17a8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:30.529713 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-473b367c-c7b2-4bd9-a36d-290d52eb17a8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1759 microversion: 2.1 time: 0.140658 Jul 30 16:12:30.530262 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 468/925] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:30 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1759 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:33.717599 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-2e45b929-979e-45a8-a0e1-63e20af05ced tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:33.718093 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-2e45b929-979e-45a8-a0e1-63e20af05ced tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:33.723893 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2e45b929-979e-45a8-a0e1-63e20af05ced tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:33.724337 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2e45b929-979e-45a8-a0e1-63e20af05ced tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:33.725099 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2e45b929-979e-45a8-a0e1-63e20af05ced tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:33.725529 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2e45b929-979e-45a8-a0e1-63e20af05ced tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:33.815284 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.objects.instance [None req-2e45b929-979e-45a8-a0e1-63e20af05ced tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lazy-loading 'services' on Instance uuid dbd5216c-577d-42c9-a471-a99a85090a20 {{(pid=107452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:12:34.039871 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-2e45b929-979e-45a8-a0e1-63e20af05ced tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "DELETE /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/os-volume_attachments/62b48b20-05f2-414a-a5ee-21b4572f7023" status: 202 len: 0 microversion: 2.1 time: 0.473953 Jul 30 16:12:34.040647 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 458/926] 10.222.0.37 () {58 vars in 1416 bytes} [Fri Jul 30 16:12:33 2021] DELETE /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/os-volume_attachments/62b48b20-05f2-414a-a5ee-21b4572f7023 => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:12:35.159814 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b8feca84-5a1e-447e-9fe3-e74d190517f8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:12:35.167456 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b8feca84-5a1e-447e-9fe3-e74d190517f8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:35.167947 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b8feca84-5a1e-447e-9fe3-e74d190517f8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:35.191854 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b8feca84-5a1e-447e-9fe3-e74d190517f8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Going to try to stop instance {{(pid=107453) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Jul 30 16:12:35.235917 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b8feca84-5a1e-447e-9fe3-e74d190517f8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 202 len: 0 microversion: 2.1 time: 0.081378 Jul 30 16:12:35.236826 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 469/927] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:12:35 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:12:35.247412 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d6380f07-288b-418e-ada9-528273593f57 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:35.249632 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d6380f07-288b-418e-ada9-528273593f57 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:35.265969 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d6380f07-288b-418e-ada9-528273593f57 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:35.267468 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d6380f07-288b-418e-ada9-528273593f57 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:35.268706 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d6380f07-288b-418e-ada9-528273593f57 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:35.269323 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d6380f07-288b-418e-ada9-528273593f57 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:35.426007 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d6380f07-288b-418e-ada9-528273593f57 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:35.434665 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d6380f07-288b-418e-ada9-528273593f57 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1675 microversion: 2.1 time: 0.192420 Jul 30 16:12:35.435258 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 459/928] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:35 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1675 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:36.453115 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ff8be215-047a-496a-be68-6b0228ace28f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:36.461043 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ff8be215-047a-496a-be68-6b0228ace28f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:36.467302 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ff8be215-047a-496a-be68-6b0228ace28f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:36.467750 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ff8be215-047a-496a-be68-6b0228ace28f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:36.468523 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ff8be215-047a-496a-be68-6b0228ace28f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:36.468958 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ff8be215-047a-496a-be68-6b0228ace28f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:36.588105 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ff8be215-047a-496a-be68-6b0228ace28f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:36.595506 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ff8be215-047a-496a-be68-6b0228ace28f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1675 microversion: 2.1 time: 0.146497 Jul 30 16:12:36.596069 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 470/929] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:36 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:37.612386 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ff46e312-2f84-4497-97fc-4bf51d24ba14 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:37.612988 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ff46e312-2f84-4497-97fc-4bf51d24ba14 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:37.618902 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ff46e312-2f84-4497-97fc-4bf51d24ba14 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:37.619380 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ff46e312-2f84-4497-97fc-4bf51d24ba14 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:37.620147 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ff46e312-2f84-4497-97fc-4bf51d24ba14 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:37.620580 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ff46e312-2f84-4497-97fc-4bf51d24ba14 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:37.741981 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-ff46e312-2f84-4497-97fc-4bf51d24ba14 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:37.749953 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ff46e312-2f84-4497-97fc-4bf51d24ba14 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1675 microversion: 2.1 time: 0.141529 Jul 30 16:12:37.750508 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 460/930] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:37 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1675 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:38.766081 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-31ed8b97-ea1b-4429-8f16-dc032f7276c3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:38.766723 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-31ed8b97-ea1b-4429-8f16-dc032f7276c3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:38.773014 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-31ed8b97-ea1b-4429-8f16-dc032f7276c3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:38.773461 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-31ed8b97-ea1b-4429-8f16-dc032f7276c3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:38.774227 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-31ed8b97-ea1b-4429-8f16-dc032f7276c3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:38.774660 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-31ed8b97-ea1b-4429-8f16-dc032f7276c3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:38.904595 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-31ed8b97-ea1b-4429-8f16-dc032f7276c3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:38.912177 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-31ed8b97-ea1b-4429-8f16-dc032f7276c3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1675 microversion: 2.1 time: 0.150323 Jul 30 16:12:38.912751 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 471/931] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:38 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:39.930159 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-379eab3e-9bd7-49e4-a4e1-459411c4113a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:39.931026 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-379eab3e-9bd7-49e4-a4e1-459411c4113a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:39.938676 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-379eab3e-9bd7-49e4-a4e1-459411c4113a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:39.941742 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-379eab3e-9bd7-49e4-a4e1-459411c4113a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:39.941742 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-379eab3e-9bd7-49e4-a4e1-459411c4113a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:39.941742 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-379eab3e-9bd7-49e4-a4e1-459411c4113a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:40.141280 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-379eab3e-9bd7-49e4-a4e1-459411c4113a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:40.148788 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-379eab3e-9bd7-49e4-a4e1-459411c4113a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1675 microversion: 2.1 time: 0.222701 Jul 30 16:12:40.149348 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 461/932] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:39 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1675 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:41.166515 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-91a698fe-5181-43db-b086-ba9c5a265069 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:41.167200 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-91a698fe-5181-43db-b086-ba9c5a265069 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:41.173715 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-91a698fe-5181-43db-b086-ba9c5a265069 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:41.174201 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-91a698fe-5181-43db-b086-ba9c5a265069 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:41.175041 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-91a698fe-5181-43db-b086-ba9c5a265069 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:41.175510 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-91a698fe-5181-43db-b086-ba9c5a265069 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:41.319165 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-91a698fe-5181-43db-b086-ba9c5a265069 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:41.331467 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-91a698fe-5181-43db-b086-ba9c5a265069 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1675 microversion: 2.1 time: 0.168810 Jul 30 16:12:41.332042 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 472/933] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:41 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:42.349173 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b874bdff-cb5b-4446-905c-fea31aa1b152 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:42.349824 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b874bdff-cb5b-4446-905c-fea31aa1b152 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:42.355802 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b874bdff-cb5b-4446-905c-fea31aa1b152 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:42.356310 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b874bdff-cb5b-4446-905c-fea31aa1b152 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:42.357079 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b874bdff-cb5b-4446-905c-fea31aa1b152 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:42.357522 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b874bdff-cb5b-4446-905c-fea31aa1b152 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:42.475767 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b874bdff-cb5b-4446-905c-fea31aa1b152 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:42.483523 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b874bdff-cb5b-4446-905c-fea31aa1b152 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1675 microversion: 2.1 time: 0.138013 Jul 30 16:12:42.484084 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 462/934] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:42 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1675 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:43.499564 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d02e4277-9c51-4521-a58b-f43b24ca86d9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:43.500176 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d02e4277-9c51-4521-a58b-f43b24ca86d9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:43.506286 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d02e4277-9c51-4521-a58b-f43b24ca86d9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:43.506828 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d02e4277-9c51-4521-a58b-f43b24ca86d9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:43.507788 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d02e4277-9c51-4521-a58b-f43b24ca86d9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:43.508241 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d02e4277-9c51-4521-a58b-f43b24ca86d9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:43.632396 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d02e4277-9c51-4521-a58b-f43b24ca86d9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:43.640334 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d02e4277-9c51-4521-a58b-f43b24ca86d9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1675 microversion: 2.1 time: 0.144549 Jul 30 16:12:43.640895 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 473/935] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:43 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1675 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:44.656862 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f8a5926e-82aa-4fb7-b67a-4b80244c2cc2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:44.657549 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f8a5926e-82aa-4fb7-b67a-4b80244c2cc2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:44.663417 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f8a5926e-82aa-4fb7-b67a-4b80244c2cc2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:44.663868 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f8a5926e-82aa-4fb7-b67a-4b80244c2cc2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:44.664635 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f8a5926e-82aa-4fb7-b67a-4b80244c2cc2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:44.665071 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f8a5926e-82aa-4fb7-b67a-4b80244c2cc2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:44.786013 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f8a5926e-82aa-4fb7-b67a-4b80244c2cc2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:44.794126 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f8a5926e-82aa-4fb7-b67a-4b80244c2cc2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1675 microversion: 2.1 time: 0.141057 Jul 30 16:12:44.794697 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 463/936] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:44 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1675 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:45.811825 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c2ee929c-f390-4196-82b2-ff6ba6d7a002 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:45.812588 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c2ee929c-f390-4196-82b2-ff6ba6d7a002 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:45.818842 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c2ee929c-f390-4196-82b2-ff6ba6d7a002 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:45.819559 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c2ee929c-f390-4196-82b2-ff6ba6d7a002 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:45.820358 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c2ee929c-f390-4196-82b2-ff6ba6d7a002 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:45.820849 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c2ee929c-f390-4196-82b2-ff6ba6d7a002 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:45.970290 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c2ee929c-f390-4196-82b2-ff6ba6d7a002 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:45.977553 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c2ee929c-f390-4196-82b2-ff6ba6d7a002 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1675 microversion: 2.1 time: 0.170297 Jul 30 16:12:45.978122 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 474/937] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:45 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:46.995782 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d7155033-7903-45b9-88c8-b8b7bbcc866c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:46.997555 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d7155033-7903-45b9-88c8-b8b7bbcc866c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:47.006738 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d7155033-7903-45b9-88c8-b8b7bbcc866c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:47.007394 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d7155033-7903-45b9-88c8-b8b7bbcc866c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:47.008473 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d7155033-7903-45b9-88c8-b8b7bbcc866c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:47.008919 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d7155033-7903-45b9-88c8-b8b7bbcc866c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:47.140480 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d7155033-7903-45b9-88c8-b8b7bbcc866c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:47.152125 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d7155033-7903-45b9-88c8-b8b7bbcc866c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1675 microversion: 2.1 time: 0.160176 Jul 30 16:12:47.152747 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 464/938] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:46 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:48.170270 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-535f72ac-460c-4de4-a9d0-7500c8518004 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:48.170889 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-535f72ac-460c-4de4-a9d0-7500c8518004 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:48.176958 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-535f72ac-460c-4de4-a9d0-7500c8518004 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:48.177913 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-535f72ac-460c-4de4-a9d0-7500c8518004 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:48.184400 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-535f72ac-460c-4de4-a9d0-7500c8518004 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:48.184844 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-535f72ac-460c-4de4-a9d0-7500c8518004 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:48.320612 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-535f72ac-460c-4de4-a9d0-7500c8518004 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:48.328173 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-535f72ac-460c-4de4-a9d0-7500c8518004 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1675 microversion: 2.1 time: 0.163050 Jul 30 16:12:48.328741 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 475/939] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:48 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:49.345631 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-61f3ed80-474b-40c0-908b-4b7f709102a1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:49.347159 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-61f3ed80-474b-40c0-908b-4b7f709102a1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:49.354775 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61f3ed80-474b-40c0-908b-4b7f709102a1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:49.356239 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61f3ed80-474b-40c0-908b-4b7f709102a1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:49.357831 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61f3ed80-474b-40c0-908b-4b7f709102a1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:49.358723 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61f3ed80-474b-40c0-908b-4b7f709102a1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:49.504099 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-61f3ed80-474b-40c0-908b-4b7f709102a1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:49.514623 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-61f3ed80-474b-40c0-908b-4b7f709102a1 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1675 microversion: 2.1 time: 0.171630 Jul 30 16:12:49.528447 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 465/940] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:49 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:12:50.535220 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f96cf7b2-4f0a-4aa6-8231-2906411250de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:50.535944 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f96cf7b2-4f0a-4aa6-8231-2906411250de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:50.541760 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f96cf7b2-4f0a-4aa6-8231-2906411250de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:50.542495 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f96cf7b2-4f0a-4aa6-8231-2906411250de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:50.543450 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f96cf7b2-4f0a-4aa6-8231-2906411250de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:50.543887 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f96cf7b2-4f0a-4aa6-8231-2906411250de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:50.687848 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f96cf7b2-4f0a-4aa6-8231-2906411250de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:50.699441 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f96cf7b2-4f0a-4aa6-8231-2906411250de tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1675 microversion: 2.1 time: 0.167550 Jul 30 16:12:50.700291 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 476/941] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:50 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:51.716463 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e3e2604e-8dea-40d1-ad35-e468c9778655 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:51.717104 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e3e2604e-8dea-40d1-ad35-e468c9778655 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:51.722982 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e3e2604e-8dea-40d1-ad35-e468c9778655 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:51.723484 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e3e2604e-8dea-40d1-ad35-e468c9778655 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:51.724448 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e3e2604e-8dea-40d1-ad35-e468c9778655 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:51.724999 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e3e2604e-8dea-40d1-ad35-e468c9778655 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:51.856230 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e3e2604e-8dea-40d1-ad35-e468c9778655 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:51.863598 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e3e2604e-8dea-40d1-ad35-e468c9778655 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1652 microversion: 2.1 time: 0.150975 Jul 30 16:12:51.864158 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 466/942] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:51 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1652 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:51.879343 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e1f1d5ee-39d6-4ef7-ad6a-13bc79802fe9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:12:51.885146 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e1f1d5ee-39d6-4ef7-ad6a-13bc79802fe9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:51.885596 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e1f1d5ee-39d6-4ef7-ad6a-13bc79802fe9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:51.907824 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e1f1d5ee-39d6-4ef7-ad6a-13bc79802fe9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Going to try to start instance {{(pid=107453) start /opt/stack/nova/nova/compute/api.py:2603}} Jul 30 16:12:51.947188 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e1f1d5ee-39d6-4ef7-ad6a-13bc79802fe9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action" status: 202 len: 0 microversion: 2.1 time: 0.071423 Jul 30 16:12:51.947766 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 477/943] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:12:51 2021] POST /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20/action => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:12:51.955730 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-09ae1e3f-fc9a-4c3d-88c4-abdaddc3c105 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:51.956376 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-09ae1e3f-fc9a-4c3d-88c4-abdaddc3c105 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:51.962220 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-09ae1e3f-fc9a-4c3d-88c4-abdaddc3c105 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:51.962668 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-09ae1e3f-fc9a-4c3d-88c4-abdaddc3c105 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:51.963496 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-09ae1e3f-fc9a-4c3d-88c4-abdaddc3c105 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:51.963933 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-09ae1e3f-fc9a-4c3d-88c4-abdaddc3c105 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:52.092307 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-09ae1e3f-fc9a-4c3d-88c4-abdaddc3c105 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:52.100693 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-09ae1e3f-fc9a-4c3d-88c4-abdaddc3c105 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1661 microversion: 2.1 time: 0.148532 Jul 30 16:12:52.101486 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 467/944] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:51 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1661 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:53.119351 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-90015f16-eaea-4b19-ba2a-7318e8e347c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:53.119983 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-90015f16-eaea-4b19-ba2a-7318e8e347c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:53.126475 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-90015f16-eaea-4b19-ba2a-7318e8e347c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:53.126925 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-90015f16-eaea-4b19-ba2a-7318e8e347c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:53.127737 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-90015f16-eaea-4b19-ba2a-7318e8e347c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:53.128184 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-90015f16-eaea-4b19-ba2a-7318e8e347c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:53.249338 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-90015f16-eaea-4b19-ba2a-7318e8e347c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:53.256940 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-90015f16-eaea-4b19-ba2a-7318e8e347c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1661 microversion: 2.1 time: 0.141846 Jul 30 16:12:53.257511 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 478/945] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:53 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1661 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:54.274049 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-791804a0-a935-4243-9f10-13dd81c79ba7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:54.274658 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-791804a0-a935-4243-9f10-13dd81c79ba7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:54.280710 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-791804a0-a935-4243-9f10-13dd81c79ba7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:54.281156 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-791804a0-a935-4243-9f10-13dd81c79ba7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:54.281924 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-791804a0-a935-4243-9f10-13dd81c79ba7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:54.282357 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-791804a0-a935-4243-9f10-13dd81c79ba7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:54.408536 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-791804a0-a935-4243-9f10-13dd81c79ba7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:12:54.415985 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-791804a0-a935-4243-9f10-13dd81c79ba7 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1665 microversion: 2.1 time: 0.145541 Jul 30 16:12:54.416553 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 468/946] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:12:54 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1665 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:12:58.517836 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e27734e1-aca4-4ce6-af3e-2ea94f2eb47e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:58.518754 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e27734e1-aca4-4ce6-af3e-2ea94f2eb47e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:58.521351 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bea196f8-9d79-48be-b862-b6e155969bf4] AMQP server on 10.222.0.37:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 30 16:12:58.526017 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e27734e1-aca4-4ce6-af3e-2ea94f2eb47e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:58.526377 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e27734e1-aca4-4ce6-af3e-2ea94f2eb47e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:58.528686 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e27734e1-aca4-4ce6-af3e-2ea94f2eb47e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:58.529150 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e27734e1-aca4-4ce6-af3e-2ea94f2eb47e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:58.559331 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e27734e1-aca4-4ce6-af3e-2ea94f2eb47e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/os-volume_attachments/ef3cd35c-fbe1-48c5-aa51-f4d80f79a628" status: 200 len: 194 microversion: 2.20 time: 0.044788 Jul 30 16:12:58.559913 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 479/947] 10.222.0.37 () {60 vars in 1454 bytes} [Fri Jul 30 16:12:58 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/os-volume_attachments/ef3cd35c-fbe1-48c5-aa51-f4d80f79a628 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:12:58.626474 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d3dc9c9d-afda-47c0-b05c-428c6074c35d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:58.627022 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d3dc9c9d-afda-47c0-b05c-428c6074c35d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:58.633001 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d3dc9c9d-afda-47c0-b05c-428c6074c35d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:58.633447 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d3dc9c9d-afda-47c0-b05c-428c6074c35d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:58.634207 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d3dc9c9d-afda-47c0-b05c-428c6074c35d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:58.634634 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d3dc9c9d-afda-47c0-b05c-428c6074c35d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:58.730331 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.objects.instance [None req-d3dc9c9d-afda-47c0-b05c-428c6074c35d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lazy-loading 'services' on Instance uuid ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb {{(pid=107452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:12:58.793924 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d3dc9c9d-afda-47c0-b05c-428c6074c35d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "DELETE /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/os-volume_attachments/ef3cd35c-fbe1-48c5-aa51-f4d80f79a628" status: 202 len: 0 microversion: 2.20 time: 0.170942 Jul 30 16:12:58.794645 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 469/948] 10.222.0.37 () {60 vars in 1457 bytes} [Fri Jul 30 16:12:58 2021] DELETE /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb/os-volume_attachments/ef3cd35c-fbe1-48c5-aa51-f4d80f79a628 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 16:12:59.917914 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-fb7fd8f7-0f3e-4584-9b0e-2e877c4ee6c5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:12:59.918673 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-fb7fd8f7-0f3e-4584-9b0e-2e877c4ee6c5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:12:59.934781 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fb7fd8f7-0f3e-4584-9b0e-2e877c4ee6c5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:59.935321 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fb7fd8f7-0f3e-4584-9b0e-2e877c4ee6c5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:59.936035 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fb7fd8f7-0f3e-4584-9b0e-2e877c4ee6c5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:12:59.936467 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fb7fd8f7-0f3e-4584-9b0e-2e877c4ee6c5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:12:59.952509 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO oslo.messaging._drivers.impl_rabbit [-] [bea196f8-9d79-48be-b862-b6e155969bf4] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 52032. Jul 30 16:12:59.962979 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-fb7fd8f7-0f3e-4584-9b0e-2e877c4ee6c5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Going to try to terminate instance {{(pid=107453) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:13:00.038281 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-fb7fd8f7-0f3e-4584-9b0e-2e877c4ee6c5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "DELETE /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 204 len: 0 microversion: 2.20 time: 0.123882 Jul 30 16:13:00.039034 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 480/949] 10.222.0.37 () {60 vars in 1280 bytes} [Fri Jul 30 16:12:59 2021] DELETE /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 16:13:00.048270 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-05f6110c-33ca-4777-b106-d3ad5226c972 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:00.049490 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-05f6110c-33ca-4777-b106-d3ad5226c972 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:00.055657 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-05f6110c-33ca-4777-b106-d3ad5226c972 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:00.056109 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-05f6110c-33ca-4777-b106-d3ad5226c972 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:00.056882 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-05f6110c-33ca-4777-b106-d3ad5226c972 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:00.057316 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-05f6110c-33ca-4777-b106-d3ad5226c972 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:00.183106 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-05f6110c-33ca-4777-b106-d3ad5226c972 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:00.193301 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-05f6110c-33ca-4777-b106-d3ad5226c972 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:00.194873 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-05f6110c-33ca-4777-b106-d3ad5226c972 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:00.196116 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-05f6110c-33ca-4777-b106-d3ad5226c972 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.152431 Jul 30 16:13:00.196618 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 470/950] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:13:00 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:13:01.215954 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-798eac4a-121c-4c2b-90a2-ffd2db5fb98e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:01.216656 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-798eac4a-121c-4c2b-90a2-ffd2db5fb98e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:01.222464 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-798eac4a-121c-4c2b-90a2-ffd2db5fb98e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:01.222868 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-798eac4a-121c-4c2b-90a2-ffd2db5fb98e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:01.223670 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-798eac4a-121c-4c2b-90a2-ffd2db5fb98e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:01.224101 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-798eac4a-121c-4c2b-90a2-ffd2db5fb98e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:01.417095 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-798eac4a-121c-4c2b-90a2-ffd2db5fb98e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:01.430127 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-798eac4a-121c-4c2b-90a2-ffd2db5fb98e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:01.431980 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-798eac4a-121c-4c2b-90a2-ffd2db5fb98e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:01.433135 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-798eac4a-121c-4c2b-90a2-ffd2db5fb98e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.221684 Jul 30 16:13:01.434419 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 481/951] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:13:01 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:13:02.452585 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8d2320a4-c863-40e3-97fb-ca81e0db6bbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:02.453204 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8d2320a4-c863-40e3-97fb-ca81e0db6bbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:02.458980 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8d2320a4-c863-40e3-97fb-ca81e0db6bbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:02.459466 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8d2320a4-c863-40e3-97fb-ca81e0db6bbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:02.460237 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8d2320a4-c863-40e3-97fb-ca81e0db6bbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:02.460672 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8d2320a4-c863-40e3-97fb-ca81e0db6bbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:02.601351 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8d2320a4-c863-40e3-97fb-ca81e0db6bbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:02.609756 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8d2320a4-c863-40e3-97fb-ca81e0db6bbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:02.611328 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8d2320a4-c863-40e3-97fb-ca81e0db6bbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:02.612483 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8d2320a4-c863-40e3-97fb-ca81e0db6bbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1722 microversion: 2.20 time: 0.164564 Jul 30 16:13:02.613045 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 471/952] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:13:02 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:13:03.643493 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-5391a2ec-9b16-4895-923a-096b07b7f263 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:03.644287 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-5391a2ec-9b16-4895-923a-096b07b7f263 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:03.653855 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5391a2ec-9b16-4895-923a-096b07b7f263 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:03.654312 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5391a2ec-9b16-4895-923a-096b07b7f263 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:03.655103 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5391a2ec-9b16-4895-923a-096b07b7f263 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:03.655562 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5391a2ec-9b16-4895-923a-096b07b7f263 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:03.764353 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-5391a2ec-9b16-4895-923a-096b07b7f263 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:03.775443 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-5391a2ec-9b16-4895-923a-096b07b7f263 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:03.777308 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-5391a2ec-9b16-4895-923a-096b07b7f263 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:03.778757 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-5391a2ec-9b16-4895-923a-096b07b7f263 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 200 len: 1654 microversion: 2.20 time: 0.150604 Jul 30 16:13:03.791081 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 482/953] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:13:03 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 1654 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:13:04.014418 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-badea210-086c-4c2e-b30f-5b05855e5188 req-d0ccbf94-18df-4b6e-912c-db0325eb43b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb", "name": "network-vif-deleted", "tag": "9138d528-69f5-4703-ba07-6f85b67dc617"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:04.019946 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:13:04.019946 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:13:04.029942 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-badea210-086c-4c2e-b30f-5b05855e5188 req-d0ccbf94-18df-4b6e-912c-db0325eb43b1 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:04.030652 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-badea210-086c-4c2e-b30f-5b05855e5188 req-d0ccbf94-18df-4b6e-912c-db0325eb43b1 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:04.053749 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-badea210-086c-4c2e-b30f-5b05855e5188 req-d0ccbf94-18df-4b6e-912c-db0325eb43b1 service nova] Creating event network-vif-deleted:9138d528-69f5-4703-ba07-6f85b67dc617 for instance ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb on hv-cinder-80304 Jul 30 16:13:04.059383 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-badea210-086c-4c2e-b30f-5b05855e5188 req-d0ccbf94-18df-4b6e-912c-db0325eb43b1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229548 Jul 30 16:13:04.063329 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 472/954] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:13:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:13:04.797777 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-464b1b21-24dd-44fa-bbbc-20d338242862 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:04.799090 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-464b1b21-24dd-44fa-bbbc-20d338242862 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:04.805969 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-464b1b21-24dd-44fa-bbbc-20d338242862 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:04.806699 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-464b1b21-24dd-44fa-bbbc-20d338242862 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:04.807759 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-464b1b21-24dd-44fa-bbbc-20d338242862 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:04.808938 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-464b1b21-24dd-44fa-bbbc-20d338242862 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:04.826242 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-464b1b21-24dd-44fa-bbbc-20d338242862 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] HTTP exception thrown: Instance ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb could not be found. Jul 30 16:13:04.827480 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-464b1b21-24dd-44fa-bbbc-20d338242862 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Returning 404 to user: Instance ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb could not be found. {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:13:04.828621 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-464b1b21-24dd-44fa-bbbc-20d338242862 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 404 len: 111 microversion: 2.20 time: 0.034605 Jul 30 16:13:04.829722 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 483/955] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:13:04 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 16:13:04.838659 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8cd42369-694f-4cbd-a9c2-0326d0d02fd1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '.version_select at 0x7fb17ecd3d30>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:04.869774 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8cd42369-694f-4cbd-a9c2-0326d0d02fd1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-533505272" status: 204 len: 0 microversion: 2.20 time: 0.035072 Jul 30 16:13:04.870386 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 473/956] 10.222.0.37 () {60 vars in 1259 bytes} [Fri Jul 30 16:13:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-533505272 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 16:13:05.674295 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3b4f6732-2782-428c-b4a7-fba7a715ddbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'create', calling method: .version_select at 0x7fb17e90c700>, body: {"keypair": {"name": "tempest-keypair-142575181"}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:05.700397 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-3b4f6732-2782-428c-b4a7-fba7a715ddbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Getting quotas for project 18470f178d164e4a822da596125f2a31. Resources: {'key_pairs'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:13:05.705266 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-3b4f6732-2782-428c-b4a7-fba7a715ddbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Getting quotas for user 6aaf97d73fdd480bb6b5affcd2bdcfe4 and project 18470f178d164e4a822da596125f2a31. Resources: {'key_pairs'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:13:05.914519 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-3b4f6732-2782-428c-b4a7-fba7a715ddbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Getting quotas for project 18470f178d164e4a822da596125f2a31. Resources: {'key_pairs'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:13:05.919427 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-3b4f6732-2782-428c-b4a7-fba7a715ddbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Getting quotas for user 6aaf97d73fdd480bb6b5affcd2bdcfe4 and project 18470f178d164e4a822da596125f2a31. Resources: {'key_pairs'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:13:05.932723 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-3b4f6732-2782-428c-b4a7-fba7a715ddbf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.262377 Jul 30 16:13:05.934216 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 484/957] 10.222.0.37 () {62 vars in 1199 bytes} [Fri Jul 30 16:13:05 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 265 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jul 30 16:13:07.497746 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a610a7a2-e1b9-445e-947d-c3d99f536fda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1400550383", "imageRef": "eea29a7d-10c3-489a-adee-10be2e7a26bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d7fe3aa-ac98-4f16-a434-6dcaa4687c10"}], "security_groups": [{"name": "tempest-securitygroup--588393262"}], "key_name": "tempest-keypair-142575181", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:07.612140 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.network.neutron [None req-a610a7a2-e1b9-445e-947d-c3d99f536fda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] validate_networks() for [('4d7fe3aa-ac98-4f16-a434-6dcaa4687c10', None, None, None)] {{(pid=107452) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:13:08.093689 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-a610a7a2-e1b9-445e-947d-c3d99f536fda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Flavor limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:13:08.094124 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-a610a7a2-e1b9-445e-947d-c3d99f536fda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Image limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:13:08.094607 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-a610a7a2-e1b9-445e-947d-c3d99f536fda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Flavor pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:13:08.095003 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-a610a7a2-e1b9-445e-947d-c3d99f536fda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Image pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:13:08.095438 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-a610a7a2-e1b9-445e-947d-c3d99f536fda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:13:08.104182 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a610a7a2-e1b9-445e-947d-c3d99f536fda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:08.104670 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a610a7a2-e1b9-445e-947d-c3d99f536fda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:08.105567 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a610a7a2-e1b9-445e-947d-c3d99f536fda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:08.105984 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a610a7a2-e1b9-445e-947d-c3d99f536fda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:08.122704 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-a610a7a2-e1b9-445e-947d-c3d99f536fda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Getting quotas for project 18470f178d164e4a822da596125f2a31. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:13:08.127002 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-a610a7a2-e1b9-445e-947d-c3d99f536fda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Getting quotas for user 6aaf97d73fdd480bb6b5affcd2bdcfe4 and project 18470f178d164e4a822da596125f2a31. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:13:08.138971 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a610a7a2-e1b9-445e-947d-c3d99f536fda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Going to run 1 instances... {{(pid=107452) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:13:08.141496 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a610a7a2-e1b9-445e-947d-c3d99f536fda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eea29a7d-10c3-489a-adee-10be2e7a26bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:13:08.188153 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a610a7a2-e1b9-445e-947d-c3d99f536fda tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.694534 Jul 30 16:13:08.188791 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 474/958] 10.222.0.37 () {62 vars in 1188 bytes} [Fri Jul 30 16:13:07 2021] POST /compute/v2.1/servers => generated 401 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 30 16:13:08.198560 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9302f719-2084-4cf0-9645-1251a7747ea5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:08.199803 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9302f719-2084-4cf0-9645-1251a7747ea5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:08.265739 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9302f719-2084-4cf0-9645-1251a7747ea5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:08.273992 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9302f719-2084-4cf0-9645-1251a7747ea5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:08.275771 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9302f719-2084-4cf0-9645-1251a7747ea5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:08.276868 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9302f719-2084-4cf0-9645-1251a7747ea5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1281 microversion: 2.20 time: 0.082075 Jul 30 16:13:08.278154 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 485/959] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:13:08 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1281 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:13:09.296629 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-bb13d3e8-6683-47a3-a734-933545f92f62 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:09.297249 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-bb13d3e8-6683-47a3-a734-933545f92f62 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:09.304205 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bb13d3e8-6683-47a3-a734-933545f92f62 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:09.304728 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bb13d3e8-6683-47a3-a734-933545f92f62 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:09.305585 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bb13d3e8-6683-47a3-a734-933545f92f62 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:09.306084 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bb13d3e8-6683-47a3-a734-933545f92f62 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:09.372962 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-bb13d3e8-6683-47a3-a734-933545f92f62 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:09.381063 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-bb13d3e8-6683-47a3-a734-933545f92f62 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:09.382574 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-bb13d3e8-6683-47a3-a734-933545f92f62 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:09.383716 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-bb13d3e8-6683-47a3-a734-933545f92f62 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1333 microversion: 2.20 time: 0.091093 Jul 30 16:13:09.384631 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 475/960] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:13:09 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:13:10.403039 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-518eb126-3428-4ead-8d1a-7695073e0274 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:10.404276 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-518eb126-3428-4ead-8d1a-7695073e0274 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:10.412445 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-518eb126-3428-4ead-8d1a-7695073e0274 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:10.413038 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-518eb126-3428-4ead-8d1a-7695073e0274 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:10.413881 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-518eb126-3428-4ead-8d1a-7695073e0274 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:10.414317 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-518eb126-3428-4ead-8d1a-7695073e0274 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:10.554353 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-518eb126-3428-4ead-8d1a-7695073e0274 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:10.563680 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-518eb126-3428-4ead-8d1a-7695073e0274 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:10.565568 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-518eb126-3428-4ead-8d1a-7695073e0274 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:10.566905 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-518eb126-3428-4ead-8d1a-7695073e0274 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1406 microversion: 2.20 time: 0.167646 Jul 30 16:13:10.567466 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 486/961] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:13:10 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:13:11.088964 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-f0cbfa52-6519-4ce9-bf48-65ddf4ca8b95 req-e489e851-1c82-48e3-a50c-cc9568412ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cde02f58-42c0-417a-94c5-7b65163fb5f2", "tag": "4308e410-9d50-4a55-b027-a6d836a99289"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:11.099499 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:13:11.099499 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:13:11.117914 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-f0cbfa52-6519-4ce9-bf48-65ddf4ca8b95 req-e489e851-1c82-48e3-a50c-cc9568412ab5 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:11.118358 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-f0cbfa52-6519-4ce9-bf48-65ddf4ca8b95 req-e489e851-1c82-48e3-a50c-cc9568412ab5 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:11.135298 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-f0cbfa52-6519-4ce9-bf48-65ddf4ca8b95 req-e489e851-1c82-48e3-a50c-cc9568412ab5 service nova] Creating event network-changed:4308e410-9d50-4a55-b027-a6d836a99289 for instance cde02f58-42c0-417a-94c5-7b65163fb5f2 on hv-cinder-80304 Jul 30 16:13:11.141029 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-f0cbfa52-6519-4ce9-bf48-65ddf4ca8b95 req-e489e851-1c82-48e3-a50c-cc9568412ab5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055804 Jul 30 16:13:11.141629 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 476/962] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:13:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:13:11.585774 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-02ff7983-c71a-4251-a8fc-46366abb7590 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:11.586856 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-02ff7983-c71a-4251-a8fc-46366abb7590 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:11.593420 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-02ff7983-c71a-4251-a8fc-46366abb7590 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:11.594209 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-02ff7983-c71a-4251-a8fc-46366abb7590 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:11.595242 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-02ff7983-c71a-4251-a8fc-46366abb7590 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:11.595671 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-02ff7983-c71a-4251-a8fc-46366abb7590 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:11.735543 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-02ff7983-c71a-4251-a8fc-46366abb7590 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:11.750799 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-02ff7983-c71a-4251-a8fc-46366abb7590 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:11.753722 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-02ff7983-c71a-4251-a8fc-46366abb7590 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:11.756098 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-02ff7983-c71a-4251-a8fc-46366abb7590 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1406 microversion: 2.20 time: 0.174356 Jul 30 16:13:11.769949 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 487/963] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:13:11 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:13:12.778847 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-2ecca1f9-e87d-482c-a51b-dc90adeb096b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:12.779642 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-2ecca1f9-e87d-482c-a51b-dc90adeb096b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:12.785754 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2ecca1f9-e87d-482c-a51b-dc90adeb096b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:12.786250 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2ecca1f9-e87d-482c-a51b-dc90adeb096b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:12.787008 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2ecca1f9-e87d-482c-a51b-dc90adeb096b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:12.787490 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2ecca1f9-e87d-482c-a51b-dc90adeb096b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:12.921356 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-2ecca1f9-e87d-482c-a51b-dc90adeb096b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:12.929363 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-2ecca1f9-e87d-482c-a51b-dc90adeb096b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:12.930875 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-2ecca1f9-e87d-482c-a51b-dc90adeb096b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:12.932020 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-2ecca1f9-e87d-482c-a51b-dc90adeb096b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1406 microversion: 2.20 time: 0.158157 Jul 30 16:13:12.932579 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 477/964] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:13:12 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:13:13.949503 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2042aa50-89fb-456f-9120-998b349d6ba7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:13.950116 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-2042aa50-89fb-456f-9120-998b349d6ba7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:13.960879 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2042aa50-89fb-456f-9120-998b349d6ba7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:13.961343 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2042aa50-89fb-456f-9120-998b349d6ba7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:13.962159 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2042aa50-89fb-456f-9120-998b349d6ba7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:13.962662 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2042aa50-89fb-456f-9120-998b349d6ba7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:14.097742 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-2042aa50-89fb-456f-9120-998b349d6ba7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:14.107534 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-2042aa50-89fb-456f-9120-998b349d6ba7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:14.109132 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-2042aa50-89fb-456f-9120-998b349d6ba7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:14.110336 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2042aa50-89fb-456f-9120-998b349d6ba7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1406 microversion: 2.20 time: 0.164583 Jul 30 16:13:14.111158 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 488/965] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:13:13 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:13:15.128385 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-4aaea22c-4fdf-4466-9811-9609dfbb4077 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:15.128983 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-4aaea22c-4fdf-4466-9811-9609dfbb4077 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:15.135516 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4aaea22c-4fdf-4466-9811-9609dfbb4077 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:15.136046 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4aaea22c-4fdf-4466-9811-9609dfbb4077 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:15.136824 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4aaea22c-4fdf-4466-9811-9609dfbb4077 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:15.137255 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4aaea22c-4fdf-4466-9811-9609dfbb4077 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:15.264104 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-4aaea22c-4fdf-4466-9811-9609dfbb4077 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:15.272869 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-4aaea22c-4fdf-4466-9811-9609dfbb4077 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:15.274411 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-4aaea22c-4fdf-4466-9811-9609dfbb4077 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:15.275576 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-4aaea22c-4fdf-4466-9811-9609dfbb4077 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1406 microversion: 2.20 time: 0.150935 Jul 30 16:13:15.276072 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 478/966] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:13:15 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:13:16.294108 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0ca2c546-84b3-4d26-8735-b4f9fda6dd42 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:16.294821 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0ca2c546-84b3-4d26-8735-b4f9fda6dd42 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:16.300911 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0ca2c546-84b3-4d26-8735-b4f9fda6dd42 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:16.301362 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0ca2c546-84b3-4d26-8735-b4f9fda6dd42 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:16.302146 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0ca2c546-84b3-4d26-8735-b4f9fda6dd42 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:16.302572 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0ca2c546-84b3-4d26-8735-b4f9fda6dd42 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:16.428579 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0ca2c546-84b3-4d26-8735-b4f9fda6dd42 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:16.438796 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0ca2c546-84b3-4d26-8735-b4f9fda6dd42 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:16.440369 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0ca2c546-84b3-4d26-8735-b4f9fda6dd42 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:16.441493 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0ca2c546-84b3-4d26-8735-b4f9fda6dd42 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1406 microversion: 2.20 time: 0.151571 Jul 30 16:13:16.442049 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 489/967] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:13:16 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:13:16.972229 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-1b2eba41-ddb4-4b09-8ca9-ecf67f463e8c req-d44ae7f1-b8d1-4bb5-b430-75ad513ac896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde02f58-42c0-417a-94c5-7b65163fb5f2", "name": "network-vif-plugged", "status": "completed", "tag": "4308e410-9d50-4a55-b027-a6d836a99289"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:16.973767 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:13:16.973767 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:13:16.980705 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-1b2eba41-ddb4-4b09-8ca9-ecf67f463e8c req-d44ae7f1-b8d1-4bb5-b430-75ad513ac896 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:16.981151 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-1b2eba41-ddb4-4b09-8ca9-ecf67f463e8c req-d44ae7f1-b8d1-4bb5-b430-75ad513ac896 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:16.992554 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-1b2eba41-ddb4-4b09-8ca9-ecf67f463e8c req-d44ae7f1-b8d1-4bb5-b430-75ad513ac896 service nova] Creating event network-vif-plugged:4308e410-9d50-4a55-b027-a6d836a99289 for instance cde02f58-42c0-417a-94c5-7b65163fb5f2 on hv-cinder-80304 Jul 30 16:13:16.998031 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-1b2eba41-ddb4-4b09-8ca9-ecf67f463e8c req-d44ae7f1-b8d1-4bb5-b430-75ad513ac896 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145274 Jul 30 16:13:16.998609 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 479/968] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:13:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:13:17.459481 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-cf39524f-8862-4e59-8b48-38e249a5eeba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:17.460127 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-cf39524f-8862-4e59-8b48-38e249a5eeba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:17.466168 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cf39524f-8862-4e59-8b48-38e249a5eeba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:17.466623 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cf39524f-8862-4e59-8b48-38e249a5eeba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:17.467419 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cf39524f-8862-4e59-8b48-38e249a5eeba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:17.467857 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cf39524f-8862-4e59-8b48-38e249a5eeba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:17.588928 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-cf39524f-8862-4e59-8b48-38e249a5eeba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:17.596726 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-cf39524f-8862-4e59-8b48-38e249a5eeba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:17.598514 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-cf39524f-8862-4e59-8b48-38e249a5eeba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:17.599634 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-cf39524f-8862-4e59-8b48-38e249a5eeba tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1406 microversion: 2.20 time: 0.143875 Jul 30 16:13:17.600183 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 490/969] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:13:17 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1406 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:13:18.618427 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-43fd5c92-3598-43f9-b4a0-15b63235f6f9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:18.619126 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-43fd5c92-3598-43f9-b4a0-15b63235f6f9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:18.625439 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-43fd5c92-3598-43f9-b4a0-15b63235f6f9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:18.625894 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-43fd5c92-3598-43f9-b4a0-15b63235f6f9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:18.626659 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-43fd5c92-3598-43f9-b4a0-15b63235f6f9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:18.627095 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-43fd5c92-3598-43f9-b4a0-15b63235f6f9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:18.752644 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-43fd5c92-3598-43f9-b4a0-15b63235f6f9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:18.760675 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-43fd5c92-3598-43f9-b4a0-15b63235f6f9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:18.762959 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-43fd5c92-3598-43f9-b4a0-15b63235f6f9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:18.764121 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-43fd5c92-3598-43f9-b4a0-15b63235f6f9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1597 microversion: 2.20 time: 0.149815 Jul 30 16:13:18.764677 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 480/970] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:13:18 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1597 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:13:18.782667 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ae603170-1253-4faf-817e-913919887658 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:18.783040 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ae603170-1253-4faf-817e-913919887658 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:18.788949 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ae603170-1253-4faf-817e-913919887658 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:18.789397 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ae603170-1253-4faf-817e-913919887658 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:18.790310 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ae603170-1253-4faf-817e-913919887658 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:18.790754 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ae603170-1253-4faf-817e-913919887658 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:18.872661 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ae603170-1253-4faf-817e-913919887658 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094370 Jul 30 16:13:18.873262 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 491/971] 10.222.0.37 () {60 vars in 1316 bytes} [Fri Jul 30 16:13:18 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:13:20.143896 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-52c921cb-d191-4b9e-97d3-d6df723a4621 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:20.145063 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-52c921cb-d191-4b9e-97d3-d6df723a4621 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:20.154282 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-52c921cb-d191-4b9e-97d3-d6df723a4621 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:20.154952 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-52c921cb-d191-4b9e-97d3-d6df723a4621 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:20.155947 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-52c921cb-d191-4b9e-97d3-d6df723a4621 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:20.156534 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-52c921cb-d191-4b9e-97d3-d6df723a4621 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:20.159029 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-114e2822-f240-41a9-9ee4-f0485f61fd4f req-0de5c055-e841-48cb-b6e9-395501370470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cde02f58-42c0-417a-94c5-7b65163fb5f2", "tag": "4308e410-9d50-4a55-b027-a6d836a99289"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:20.161112 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:13:20.161112 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:13:20.169219 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-114e2822-f240-41a9-9ee4-f0485f61fd4f req-0de5c055-e841-48cb-b6e9-395501370470 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:20.169662 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-114e2822-f240-41a9-9ee4-f0485f61fd4f req-0de5c055-e841-48cb-b6e9-395501370470 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:20.181320 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-114e2822-f240-41a9-9ee4-f0485f61fd4f req-0de5c055-e841-48cb-b6e9-395501370470 service nova] Creating event network-changed:4308e410-9d50-4a55-b027-a6d836a99289 for instance cde02f58-42c0-417a-94c5-7b65163fb5f2 on hv-cinder-80304 Jul 30 16:13:20.187724 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-114e2822-f240-41a9-9ee4-f0485f61fd4f req-0de5c055-e841-48cb-b6e9-395501370470 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032868 Jul 30 16:13:20.188802 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 492/972] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:13:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:13:20.249750 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-52c921cb-d191-4b9e-97d3-d6df723a4621 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 14 microversion: 2.20 time: 0.109236 Jul 30 16:13:20.251245 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 481/973] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:20 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:21.261612 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c26f6b72-42c7-4593-ae53-c55dd293e77f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:21.262620 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c26f6b72-42c7-4593-ae53-c55dd293e77f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:21.271398 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c26f6b72-42c7-4593-ae53-c55dd293e77f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:21.272072 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c26f6b72-42c7-4593-ae53-c55dd293e77f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:21.273102 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c26f6b72-42c7-4593-ae53-c55dd293e77f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:21.273613 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c26f6b72-42c7-4593-ae53-c55dd293e77f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:21.351539 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c26f6b72-42c7-4593-ae53-c55dd293e77f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 14 microversion: 2.20 time: 0.093954 Jul 30 16:13:21.352169 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 493/974] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:21 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:22.362709 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a11cb3a4-f443-4c9e-a060-9882912f49db tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:22.363729 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a11cb3a4-f443-4c9e-a060-9882912f49db tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:22.370205 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a11cb3a4-f443-4c9e-a060-9882912f49db tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:22.370686 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a11cb3a4-f443-4c9e-a060-9882912f49db tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:22.371593 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a11cb3a4-f443-4c9e-a060-9882912f49db tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:22.372025 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a11cb3a4-f443-4c9e-a060-9882912f49db tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:22.454948 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a11cb3a4-f443-4c9e-a060-9882912f49db tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 14 microversion: 2.20 time: 0.096141 Jul 30 16:13:22.455587 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 482/975] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:22 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:23.466899 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-37ec0086-0940-455b-b858-904bbf635de3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:23.467950 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-37ec0086-0940-455b-b858-904bbf635de3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:23.474392 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-37ec0086-0940-455b-b858-904bbf635de3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:23.474840 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-37ec0086-0940-455b-b858-904bbf635de3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:23.475647 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-37ec0086-0940-455b-b858-904bbf635de3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:23.476084 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-37ec0086-0940-455b-b858-904bbf635de3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:23.556979 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-37ec0086-0940-455b-b858-904bbf635de3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 14 microversion: 2.20 time: 0.094583 Jul 30 16:13:23.557507 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 494/976] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:23 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:13:24.568370 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e660d95d-8803-41da-afaa-f8ff3d02ff59 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:24.569275 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e660d95d-8803-41da-afaa-f8ff3d02ff59 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:24.576402 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e660d95d-8803-41da-afaa-f8ff3d02ff59 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:24.576858 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e660d95d-8803-41da-afaa-f8ff3d02ff59 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:24.577629 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e660d95d-8803-41da-afaa-f8ff3d02ff59 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:24.578066 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e660d95d-8803-41da-afaa-f8ff3d02ff59 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:24.652232 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e660d95d-8803-41da-afaa-f8ff3d02ff59 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 14 microversion: 2.20 time: 0.087852 Jul 30 16:13:24.652830 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 483/977] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:24 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:24.924785 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-95c3ebd2-b4fb-48ce-a7b0-c0d163a10510 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1824267616"}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:24.925332 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-95c3ebd2-b4fb-48ce-a7b0-c0d163a10510 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:24.931753 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95c3ebd2-b4fb-48ce-a7b0-c0d163a10510 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:24.932200 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95c3ebd2-b4fb-48ce-a7b0-c0d163a10510 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:24.932960 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95c3ebd2-b4fb-48ce-a7b0-c0d163a10510 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:24.934010 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95c3ebd2-b4fb-48ce-a7b0-c0d163a10510 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:25.051561 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.network.security_group_api [None req-95c3ebd2-b4fb-48ce-a7b0-c0d163a10510 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Removing security group 9e4ad6e6-0dd6-4ead-909d-5555aa5d6d92 from port be55314f-44d9-47f6-87fd-5d73fbe32ff7 Jul 30 16:13:25.383580 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-95c3ebd2-b4fb-48ce-a7b0-c0d163a10510 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "POST /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/action" status: 202 len: 0 microversion: 2.1 time: 0.461879 Jul 30 16:13:25.384907 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 495/978] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:13:24 2021] POST /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:25.647910 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-b8ef3cd7-785a-4745-9050-8dde37bd4311 req-7e8620a5-50b7-4ca9-8d32-70a9ededdcd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb0becf-8d14-4c6b-8b46-82c09b52a5a6", "tag": "be55314f-44d9-47f6-87fd-5d73fbe32ff7"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:25.649305 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:13:25.649305 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:13:25.657038 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-b8ef3cd7-785a-4745-9050-8dde37bd4311 req-7e8620a5-50b7-4ca9-8d32-70a9ededdcd2 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:25.657736 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-b8ef3cd7-785a-4745-9050-8dde37bd4311 req-7e8620a5-50b7-4ca9-8d32-70a9ededdcd2 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:25.663069 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-54a4edc7-c9d2-465d-ad65-d21b9da77cbe tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:25.664336 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-54a4edc7-c9d2-465d-ad65-d21b9da77cbe tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:25.670305 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-b8ef3cd7-785a-4745-9050-8dde37bd4311 req-7e8620a5-50b7-4ca9-8d32-70a9ededdcd2 service nova] Creating event network-changed:be55314f-44d9-47f6-87fd-5d73fbe32ff7 for instance 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 on hv-cinder-80304 Jul 30 16:13:25.674970 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-54a4edc7-c9d2-465d-ad65-d21b9da77cbe tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:25.675185 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-b8ef3cd7-785a-4745-9050-8dde37bd4311 req-7e8620a5-50b7-4ca9-8d32-70a9ededdcd2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.287911 Jul 30 16:13:25.676018 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 484/979] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:13:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:13:25.678545 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-54a4edc7-c9d2-465d-ad65-d21b9da77cbe tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:25.679726 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-54a4edc7-c9d2-465d-ad65-d21b9da77cbe tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:25.679897 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-54a4edc7-c9d2-465d-ad65-d21b9da77cbe tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:25.782056 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-54a4edc7-c9d2-465d-ad65-d21b9da77cbe tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 14 microversion: 2.20 time: 0.122243 Jul 30 16:13:25.786094 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 496/980] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:25 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:13:26.794741 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e5bd657a-630e-46b6-ac17-8c33c81d59e0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:26.795811 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e5bd657a-630e-46b6-ac17-8c33c81d59e0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:26.801784 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e5bd657a-630e-46b6-ac17-8c33c81d59e0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:26.802242 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e5bd657a-630e-46b6-ac17-8c33c81d59e0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:26.803014 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e5bd657a-630e-46b6-ac17-8c33c81d59e0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:26.803478 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e5bd657a-630e-46b6-ac17-8c33c81d59e0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:26.878447 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e5bd657a-630e-46b6-ac17-8c33c81d59e0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 14 microversion: 2.20 time: 0.088215 Jul 30 16:13:26.879155 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 485/981] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:26 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:26.879540 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-647562df-ae81-4c5a-a9c5-e73d060717ad tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:26.880201 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-647562df-ae81-4c5a-a9c5-e73d060717ad tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:26.885060 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-8f645187-f511-420f-9a21-fc124c4ee446 req-1c3f60bc-f276-4803-a513-871e14442a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb0becf-8d14-4c6b-8b46-82c09b52a5a6", "tag": "be55314f-44d9-47f6-87fd-5d73fbe32ff7"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:26.887326 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:13:26.887326 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:13:26.888534 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-647562df-ae81-4c5a-a9c5-e73d060717ad tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:26.889064 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-647562df-ae81-4c5a-a9c5-e73d060717ad tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:26.889953 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-647562df-ae81-4c5a-a9c5-e73d060717ad tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:26.890484 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-647562df-ae81-4c5a-a9c5-e73d060717ad tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:26.896617 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-8f645187-f511-420f-9a21-fc124c4ee446 req-1c3f60bc-f276-4803-a513-871e14442a96 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:26.897069 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-8f645187-f511-420f-9a21-fc124c4ee446 req-1c3f60bc-f276-4803-a513-871e14442a96 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:26.909287 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-8f645187-f511-420f-9a21-fc124c4ee446 req-1c3f60bc-f276-4803-a513-871e14442a96 service nova] Creating event network-changed:be55314f-44d9-47f6-87fd-5d73fbe32ff7 for instance 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 on hv-cinder-80304 Jul 30 16:13:26.914430 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-8f645187-f511-420f-9a21-fc124c4ee446 req-1c3f60bc-f276-4803-a513-871e14442a96 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033039 Jul 30 16:13:26.915109 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 486/982] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:13:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:13:26.980652 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.objects.instance [None req-647562df-ae81-4c5a-a9c5-e73d060717ad tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lazy-loading 'services' on Instance uuid 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 {{(pid=107453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:13:27.046304 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-647562df-ae81-4c5a-a9c5-e73d060717ad tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "DELETE /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments/d30997f7-5508-4e25-8f69-a1919e2148d5" status: 202 len: 0 microversion: 2.1 time: 0.171959 Jul 30 16:13:27.047113 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 497/983] 10.222.0.37 () {58 vars in 1416 bytes} [Fri Jul 30 16:13:26 2021] DELETE /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments/d30997f7-5508-4e25-8f69-a1919e2148d5 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:27.056145 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-2699875f-a019-48ac-a33e-d57560989ce4 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:27.057148 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-2699875f-a019-48ac-a33e-d57560989ce4 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:27.063653 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2699875f-a019-48ac-a33e-d57560989ce4 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:27.064098 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2699875f-a019-48ac-a33e-d57560989ce4 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:27.064898 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2699875f-a019-48ac-a33e-d57560989ce4 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:27.065332 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2699875f-a019-48ac-a33e-d57560989ce4 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:27.094112 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-2699875f-a019-48ac-a33e-d57560989ce4 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042234 Jul 30 16:13:27.094855 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 487/984] 10.222.0.37 () {58 vars in 1302 bytes} [Fri Jul 30 16:13:27 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:13:27.891049 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-fb61d207-d686-433f-ab88-fb0d1a1d6dd7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:27.892117 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-fb61d207-d686-433f-ab88-fb0d1a1d6dd7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:27.898771 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fb61d207-d686-433f-ab88-fb0d1a1d6dd7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:27.899249 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fb61d207-d686-433f-ab88-fb0d1a1d6dd7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:27.900004 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fb61d207-d686-433f-ab88-fb0d1a1d6dd7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:27.900425 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fb61d207-d686-433f-ab88-fb0d1a1d6dd7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:28.105882 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f40db6d4-9bfa-4218-b965-cd6df21f039e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:28.106712 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f40db6d4-9bfa-4218-b965-cd6df21f039e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:28.113280 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f40db6d4-9bfa-4218-b965-cd6df21f039e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:28.113730 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f40db6d4-9bfa-4218-b965-cd6df21f039e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:28.114488 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f40db6d4-9bfa-4218-b965-cd6df21f039e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:28.114914 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f40db6d4-9bfa-4218-b965-cd6df21f039e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:28.144615 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f40db6d4-9bfa-4218-b965-cd6df21f039e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042358 Jul 30 16:13:28.145152 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 488/985] 10.222.0.37 () {58 vars in 1302 bytes} [Fri Jul 30 16:13:28 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:13:29.156097 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-32b756e3-365a-4770-ab42-bbb715648c2c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:29.157008 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-32b756e3-365a-4770-ab42-bbb715648c2c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:29.162876 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-32b756e3-365a-4770-ab42-bbb715648c2c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:29.163362 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-32b756e3-365a-4770-ab42-bbb715648c2c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:29.164133 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-32b756e3-365a-4770-ab42-bbb715648c2c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:29.164569 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-32b756e3-365a-4770-ab42-bbb715648c2c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:29.193514 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-32b756e3-365a-4770-ab42-bbb715648c2c tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041186 Jul 30 16:13:29.194055 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 489/986] 10.222.0.37 () {58 vars in 1302 bytes} [Fri Jul 30 16:13:29 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:13:30.205461 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-da6ddf41-2224-4443-9944-e6021c99a038 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:30.206368 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-da6ddf41-2224-4443-9944-e6021c99a038 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:30.212595 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-da6ddf41-2224-4443-9944-e6021c99a038 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:30.213040 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-da6ddf41-2224-4443-9944-e6021c99a038 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:30.213804 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-da6ddf41-2224-4443-9944-e6021c99a038 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:30.214237 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-da6ddf41-2224-4443-9944-e6021c99a038 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:30.242498 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-da6ddf41-2224-4443-9944-e6021c99a038 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040865 Jul 30 16:13:30.243035 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 490/987] 10.222.0.37 () {58 vars in 1302 bytes} [Fri Jul 30 16:13:30 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:13:30.410958 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-fb61d207-d686-433f-ab88-fb0d1a1d6dd7 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 14 microversion: 2.20 time: 2.524532 Jul 30 16:13:30.414422 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 498/988] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:27 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 14 bytes in 2529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:13:31.254567 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d368baa5-50ba-47ee-818c-877c1cdf3231 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:31.255489 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d368baa5-50ba-47ee-818c-877c1cdf3231 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:31.261754 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d368baa5-50ba-47ee-818c-877c1cdf3231 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:31.262147 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d368baa5-50ba-47ee-818c-877c1cdf3231 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:31.262954 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d368baa5-50ba-47ee-818c-877c1cdf3231 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:31.263410 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d368baa5-50ba-47ee-818c-877c1cdf3231 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:31.292251 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d368baa5-50ba-47ee-818c-877c1cdf3231 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041464 Jul 30 16:13:31.292830 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 491/989] 10.222.0.37 () {58 vars in 1302 bytes} [Fri Jul 30 16:13:31 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:13:31.422446 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-aef0f0b9-e800-488e-989f-a62bbfb98e33 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:31.423441 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-aef0f0b9-e800-488e-989f-a62bbfb98e33 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:31.429930 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-aef0f0b9-e800-488e-989f-a62bbfb98e33 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:31.430423 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-aef0f0b9-e800-488e-989f-a62bbfb98e33 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:31.431220 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-aef0f0b9-e800-488e-989f-a62bbfb98e33 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:31.431660 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-aef0f0b9-e800-488e-989f-a62bbfb98e33 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:31.516055 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-aef0f0b9-e800-488e-989f-a62bbfb98e33 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 14 microversion: 2.20 time: 0.097661 Jul 30 16:13:31.516672 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 499/990] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:31 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:31.703850 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 16:13:31.704037 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: Fri Jul 30 16:13:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 16:13:32.303546 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f89cf4ee-7d99-4a9c-8ae9-b42209c842d2 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:32.304558 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f89cf4ee-7d99-4a9c-8ae9-b42209c842d2 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:32.310339 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f89cf4ee-7d99-4a9c-8ae9-b42209c842d2 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:32.310779 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f89cf4ee-7d99-4a9c-8ae9-b42209c842d2 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:32.311556 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f89cf4ee-7d99-4a9c-8ae9-b42209c842d2 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:32.311984 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f89cf4ee-7d99-4a9c-8ae9-b42209c842d2 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:32.340641 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f89cf4ee-7d99-4a9c-8ae9-b42209c842d2 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040817 Jul 30 16:13:32.341179 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 492/991] 10.222.0.37 () {58 vars in 1302 bytes} [Fri Jul 30 16:13:32 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:13:32.528635 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0b31118f-6caa-4c13-b6fc-586c07301783 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:32.529661 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0b31118f-6caa-4c13-b6fc-586c07301783 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:32.535997 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0b31118f-6caa-4c13-b6fc-586c07301783 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:32.536445 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0b31118f-6caa-4c13-b6fc-586c07301783 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:32.537277 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0b31118f-6caa-4c13-b6fc-586c07301783 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:32.537721 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0b31118f-6caa-4c13-b6fc-586c07301783 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:32.622064 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0b31118f-6caa-4c13-b6fc-586c07301783 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 14 microversion: 2.20 time: 0.097751 Jul 30 16:13:32.622622 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 500/992] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:32 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:33.351883 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-dce44b6e-3080-4e4a-b7e4-059b180a708b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:33.352788 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-dce44b6e-3080-4e4a-b7e4-059b180a708b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:33.359153 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dce44b6e-3080-4e4a-b7e4-059b180a708b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:33.359617 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dce44b6e-3080-4e4a-b7e4-059b180a708b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:33.360376 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dce44b6e-3080-4e4a-b7e4-059b180a708b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:33.360807 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dce44b6e-3080-4e4a-b7e4-059b180a708b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:33.388467 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-dce44b6e-3080-4e4a-b7e4-059b180a708b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040378 Jul 30 16:13:33.389006 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 493/993] 10.222.0.37 () {58 vars in 1302 bytes} [Fri Jul 30 16:13:33 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:13:33.399350 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e65a5e88-8535-4191-900b-4a25e8b9bb40 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:33.399938 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e65a5e88-8535-4191-900b-4a25e8b9bb40 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:33.406942 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e65a5e88-8535-4191-900b-4a25e8b9bb40 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:33.407428 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e65a5e88-8535-4191-900b-4a25e8b9bb40 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:33.408210 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e65a5e88-8535-4191-900b-4a25e8b9bb40 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:33.408648 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e65a5e88-8535-4191-900b-4a25e8b9bb40 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:33.484865 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-e65a5e88-8535-4191-900b-4a25e8b9bb40 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] HTTP exception thrown: Instance 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 is not attached to volume d30997f7-5508-4e25-8f69-a1919e2148d5 Jul 30 16:13:33.485471 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e65a5e88-8535-4191-900b-4a25e8b9bb40 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Returning 404 to user: Instance 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 is not attached to volume d30997f7-5508-4e25-8f69-a1919e2148d5 {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:13:33.486305 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e65a5e88-8535-4191-900b-4a25e8b9bb40 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "DELETE /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments/d30997f7-5508-4e25-8f69-a1919e2148d5" status: 404 len: 154 microversion: 2.1 time: 0.091289 Jul 30 16:13:33.486871 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 501/994] 10.222.0.37 () {58 vars in 1416 bytes} [Fri Jul 30 16:13:33 2021] DELETE /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6/os-volume_attachments/d30997f7-5508-4e25-8f69-a1919e2148d5 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 16:13:33.632523 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8cb3f68f-bd40-405a-aaf8-f2c89b8c986d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:33.633427 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8cb3f68f-bd40-405a-aaf8-f2c89b8c986d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:33.640046 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8cb3f68f-bd40-405a-aaf8-f2c89b8c986d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:33.640498 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8cb3f68f-bd40-405a-aaf8-f2c89b8c986d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:33.641268 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8cb3f68f-bd40-405a-aaf8-f2c89b8c986d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:33.641703 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8cb3f68f-bd40-405a-aaf8-f2c89b8c986d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:33.716219 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8cb3f68f-bd40-405a-aaf8-f2c89b8c986d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 14 microversion: 2.20 time: 0.087235 Jul 30 16:13:33.716840 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 494/995] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:33 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:34.617150 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c1cba945-bc56-459d-ac2b-58324c052f8e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:34.617681 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c1cba945-bc56-459d-ac2b-58324c052f8e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:34.623977 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c1cba945-bc56-459d-ac2b-58324c052f8e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:34.624458 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c1cba945-bc56-459d-ac2b-58324c052f8e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:34.625231 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c1cba945-bc56-459d-ac2b-58324c052f8e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:34.625670 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c1cba945-bc56-459d-ac2b-58324c052f8e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:34.649473 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c1cba945-bc56-459d-ac2b-58324c052f8e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Going to try to terminate instance {{(pid=107453) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:13:34.723510 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c1cba945-bc56-459d-ac2b-58324c052f8e tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "DELETE /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 204 len: 0 microversion: 2.1 time: 0.109595 Jul 30 16:13:34.724273 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 502/996] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:13:34 2021] DELETE /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 16:13:34.728206 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d56543f8-d524-491e-a957-b63ee2f15495 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:34.729292 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d56543f8-d524-491e-a957-b63ee2f15495 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:34.733823 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8ee7ff87-ee52-4618-8ab8-91b0f348f44d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:34.734524 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-8ee7ff87-ee52-4618-8ab8-91b0f348f44d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:34.737403 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d56543f8-d524-491e-a957-b63ee2f15495 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:34.737842 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d56543f8-d524-491e-a957-b63ee2f15495 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:34.738611 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d56543f8-d524-491e-a957-b63ee2f15495 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:34.739041 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d56543f8-d524-491e-a957-b63ee2f15495 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:34.740277 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8ee7ff87-ee52-4618-8ab8-91b0f348f44d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:34.740727 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8ee7ff87-ee52-4618-8ab8-91b0f348f44d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:34.741491 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8ee7ff87-ee52-4618-8ab8-91b0f348f44d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:34.741924 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8ee7ff87-ee52-4618-8ab8-91b0f348f44d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:34.863463 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-8ee7ff87-ee52-4618-8ab8-91b0f348f44d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:34.870831 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8ee7ff87-ee52-4618-8ab8-91b0f348f44d tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1554 microversion: 2.1 time: 0.141970 Jul 30 16:13:34.871590 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 503/997] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:34 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1554 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:13:35.888768 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c862e2d5-eaa0-424d-b431-8972e690f4b2 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:35.889452 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c862e2d5-eaa0-424d-b431-8972e690f4b2 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:35.895932 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c862e2d5-eaa0-424d-b431-8972e690f4b2 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:35.896384 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c862e2d5-eaa0-424d-b431-8972e690f4b2 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:35.897180 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c862e2d5-eaa0-424d-b431-8972e690f4b2 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:35.897614 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c862e2d5-eaa0-424d-b431-8972e690f4b2 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:36.015106 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c862e2d5-eaa0-424d-b431-8972e690f4b2 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:36.022471 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c862e2d5-eaa0-424d-b431-8972e690f4b2 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1554 microversion: 2.1 time: 0.138171 Jul 30 16:13:36.023013 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 504/998] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:35 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1554 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:13:37.039986 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-99bbacf5-7e90-4430-ac7f-97ab3f981c2b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:37.040663 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-99bbacf5-7e90-4430-ac7f-97ab3f981c2b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:37.046857 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-99bbacf5-7e90-4430-ac7f-97ab3f981c2b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:37.047430 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-99bbacf5-7e90-4430-ac7f-97ab3f981c2b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:37.048414 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-99bbacf5-7e90-4430-ac7f-97ab3f981c2b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:37.048668 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-99bbacf5-7e90-4430-ac7f-97ab3f981c2b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:37.169407 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-99bbacf5-7e90-4430-ac7f-97ab3f981c2b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:37.176559 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-99bbacf5-7e90-4430-ac7f-97ab3f981c2b tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1554 microversion: 2.1 time: 0.140216 Jul 30 16:13:37.177109 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 505/999] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:37 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1554 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:13:37.729402 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d56543f8-d524-491e-a957-b63ee2f15495 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 14772 microversion: 2.20 time: 3.006013 Jul 30 16:13:37.730282 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 495/1000] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:34 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 14772 bytes in 3008 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:13:38.193356 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ccff44f7-021f-4c6f-87e5-5d62ae2cf1b8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:38.193956 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ccff44f7-021f-4c6f-87e5-5d62ae2cf1b8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:38.199970 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ccff44f7-021f-4c6f-87e5-5d62ae2cf1b8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:38.200563 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ccff44f7-021f-4c6f-87e5-5d62ae2cf1b8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:38.201330 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ccff44f7-021f-4c6f-87e5-5d62ae2cf1b8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:38.201756 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ccff44f7-021f-4c6f-87e5-5d62ae2cf1b8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:38.321820 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ccff44f7-021f-4c6f-87e5-5d62ae2cf1b8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:38.329097 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ccff44f7-021f-4c6f-87e5-5d62ae2cf1b8 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1554 microversion: 2.1 time: 0.139408 Jul 30 16:13:38.329654 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 506/1001] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:38 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1554 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:38.740251 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-7ed51545-546d-4aab-b5e7-11d4a7e0b820 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:38.741234 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7ed51545-546d-4aab-b5e7-11d4a7e0b820 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:38.747745 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7ed51545-546d-4aab-b5e7-11d4a7e0b820 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:38.748184 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7ed51545-546d-4aab-b5e7-11d4a7e0b820 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:38.748939 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7ed51545-546d-4aab-b5e7-11d4a7e0b820 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:38.749364 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7ed51545-546d-4aab-b5e7-11d4a7e0b820 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:38.828310 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-7ed51545-546d-4aab-b5e7-11d4a7e0b820 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 17602 microversion: 2.20 time: 0.091871 Jul 30 16:13:38.828877 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 496/1002] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:38 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 17602 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:39.346168 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1189b12f-c054-41f2-a775-f5cf244b5356 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:39.346781 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1189b12f-c054-41f2-a775-f5cf244b5356 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:39.352631 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1189b12f-c054-41f2-a775-f5cf244b5356 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:39.353086 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1189b12f-c054-41f2-a775-f5cf244b5356 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:39.353850 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1189b12f-c054-41f2-a775-f5cf244b5356 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:39.354292 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1189b12f-c054-41f2-a775-f5cf244b5356 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:39.473506 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1189b12f-c054-41f2-a775-f5cf244b5356 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:39.481272 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1189b12f-c054-41f2-a775-f5cf244b5356 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1554 microversion: 2.1 time: 0.138830 Jul 30 16:13:39.481823 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 507/1003] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:39 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1554 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:39.840170 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-718d6a6d-aee0-4f28-9a3a-68ccd3844083 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:39.841179 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-718d6a6d-aee0-4f28-9a3a-68ccd3844083 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:39.847579 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-718d6a6d-aee0-4f28-9a3a-68ccd3844083 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:39.848031 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-718d6a6d-aee0-4f28-9a3a-68ccd3844083 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:39.848799 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-718d6a6d-aee0-4f28-9a3a-68ccd3844083 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:39.849237 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-718d6a6d-aee0-4f28-9a3a-68ccd3844083 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:39.941404 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-718d6a6d-aee0-4f28-9a3a-68ccd3844083 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 17960 microversion: 2.20 time: 0.104294 Jul 30 16:13:39.941404 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 497/1004] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:39 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 17960 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:40.499968 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d7c97c37-cd53-4f50-a0c0-e15324287879 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:40.500872 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d7c97c37-cd53-4f50-a0c0-e15324287879 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:40.509266 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d7c97c37-cd53-4f50-a0c0-e15324287879 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:40.510075 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d7c97c37-cd53-4f50-a0c0-e15324287879 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:40.511487 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d7c97c37-cd53-4f50-a0c0-e15324287879 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:40.512276 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d7c97c37-cd53-4f50-a0c0-e15324287879 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:40.603235 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d7c97c37-cd53-4f50-a0c0-e15324287879 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fb206da5e46bfaff79505e5029132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36597e2839440af8e51082842f1d063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:40.612449 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d7c97c37-cd53-4f50-a0c0-e15324287879 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 200 len: 1512 microversion: 2.1 time: 0.117228 Jul 30 16:13:40.615934 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 508/1005] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:40 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 1512 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:40.646285 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-6e51612a-ae1b-4e87-9b90-d53702b1ac96 req-d6b8659f-75f0-4887-8f9e-cdaff255df7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb0becf-8d14-4c6b-8b46-82c09b52a5a6", "name": "network-vif-deleted", "tag": "be55314f-44d9-47f6-87fd-5d73fbe32ff7"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:40.648078 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:13:40.648078 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:13:40.656198 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-6e51612a-ae1b-4e87-9b90-d53702b1ac96 req-d6b8659f-75f0-4887-8f9e-cdaff255df7e service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:40.656637 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-6e51612a-ae1b-4e87-9b90-d53702b1ac96 req-d6b8659f-75f0-4887-8f9e-cdaff255df7e service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:40.668942 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-6e51612a-ae1b-4e87-9b90-d53702b1ac96 req-d6b8659f-75f0-4887-8f9e-cdaff255df7e service nova] Creating event network-vif-deleted:be55314f-44d9-47f6-87fd-5d73fbe32ff7 for instance 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 on hv-cinder-80304 Jul 30 16:13:40.673517 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-6e51612a-ae1b-4e87-9b90-d53702b1ac96 req-d6b8659f-75f0-4887-8f9e-cdaff255df7e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032057 Jul 30 16:13:40.674097 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 498/1006] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:13:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:13:40.952985 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-95d923f6-7b78-4ce7-9333-3d857add754d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:40.953939 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-95d923f6-7b78-4ce7-9333-3d857add754d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:40.959932 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95d923f6-7b78-4ce7-9333-3d857add754d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:40.960387 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95d923f6-7b78-4ce7-9333-3d857add754d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:40.961173 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95d923f6-7b78-4ce7-9333-3d857add754d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:40.961613 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-95d923f6-7b78-4ce7-9333-3d857add754d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:41.030359 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-95d923f6-7b78-4ce7-9333-3d857add754d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 19342 microversion: 2.20 time: 0.081643 Jul 30 16:13:41.031005 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 509/1007] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:40 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 19342 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:41.630664 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1f7647d8-6ba3-4bd1-927e-95d08bef6887 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:41.631379 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1f7647d8-6ba3-4bd1-927e-95d08bef6887 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] [instance: 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:41.638017 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f7647d8-6ba3-4bd1-927e-95d08bef6887 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:41.638542 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f7647d8-6ba3-4bd1-927e-95d08bef6887 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:41.639377 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f7647d8-6ba3-4bd1-927e-95d08bef6887 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:41.639809 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f7647d8-6ba3-4bd1-927e-95d08bef6887 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:41.653500 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-1f7647d8-6ba3-4bd1-927e-95d08bef6887 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] HTTP exception thrown: Instance 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 could not be found. Jul 30 16:13:41.654019 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1f7647d8-6ba3-4bd1-927e-95d08bef6887 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Returning 404 to user: Instance 2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:13:41.654833 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1f7647d8-6ba3-4bd1-927e-95d08bef6887 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6" status: 404 len: 111 microversion: 2.1 time: 0.028211 Jul 30 16:13:41.655386 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 499/1008] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:41 2021] GET /compute/v2.1/servers/2fb0becf-8d14-4c6b-8b46-82c09b52a5a6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:13:41.663795 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-bf6db7c8-18ce-4b3e-84ee-1361f5dd1307 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] Calling method '.version_select at 0x7fb17e9000d0>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:41.681744 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-bf6db7c8-18ce-4b3e-84ee-1361f5dd1307 tempest-TestMinimumBasicScenario-1877048702 tempest-TestMinimumBasicScenario-1877048702-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-31089851" status: 202 len: 0 microversion: 2.1 time: 0.021922 Jul 30 16:13:41.682280 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 510/1009] 10.222.0.37 () {58 vars in 1266 bytes} [Fri Jul 30 16:13:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-31089851 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:42.044324 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e8b89a8c-71cc-4161-8e73-7b44ebba8667 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:42.045462 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e8b89a8c-71cc-4161-8e73-7b44ebba8667 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:42.054044 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e8b89a8c-71cc-4161-8e73-7b44ebba8667 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:42.054628 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e8b89a8c-71cc-4161-8e73-7b44ebba8667 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:42.055547 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e8b89a8c-71cc-4161-8e73-7b44ebba8667 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:42.055940 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e8b89a8c-71cc-4161-8e73-7b44ebba8667 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:42.131691 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e8b89a8c-71cc-4161-8e73-7b44ebba8667 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 21840 microversion: 2.20 time: 0.092588 Jul 30 16:13:42.132419 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 500/1010] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:42 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 21840 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:43.146512 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0a7f460b-60c0-48b2-8131-0cb17118fc67 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:43.148335 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0a7f460b-60c0-48b2-8131-0cb17118fc67 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:43.160047 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0a7f460b-60c0-48b2-8131-0cb17118fc67 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:43.160901 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0a7f460b-60c0-48b2-8131-0cb17118fc67 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:43.161695 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0a7f460b-60c0-48b2-8131-0cb17118fc67 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:43.162292 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0a7f460b-60c0-48b2-8131-0cb17118fc67 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:43.244317 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0a7f460b-60c0-48b2-8131-0cb17118fc67 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 23045 microversion: 2.20 time: 0.103570 Jul 30 16:13:43.248977 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 511/1011] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:43 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 23045 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:44.256315 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-fa7e4f51-d5f1-4bbe-b944-ec4c9f4ce1d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:44.257290 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-fa7e4f51-d5f1-4bbe-b944-ec4c9f4ce1d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:44.274161 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fa7e4f51-d5f1-4bbe-b944-ec4c9f4ce1d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:44.274468 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fa7e4f51-d5f1-4bbe-b944-ec4c9f4ce1d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:44.275493 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fa7e4f51-d5f1-4bbe-b944-ec4c9f4ce1d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:44.276112 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fa7e4f51-d5f1-4bbe-b944-ec4c9f4ce1d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:44.366546 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-fa7e4f51-d5f1-4bbe-b944-ec4c9f4ce1d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 23945 microversion: 2.20 time: 0.114043 Jul 30 16:13:44.367726 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 501/1012] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:44 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 23945 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:45.378687 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-eaf443b5-08fb-41c3-b9a6-d46c0c1c3f5f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:45.379714 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-eaf443b5-08fb-41c3-b9a6-d46c0c1c3f5f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:45.386068 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-eaf443b5-08fb-41c3-b9a6-d46c0c1c3f5f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:45.386515 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-eaf443b5-08fb-41c3-b9a6-d46c0c1c3f5f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:45.388034 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-eaf443b5-08fb-41c3-b9a6-d46c0c1c3f5f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:45.388477 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-eaf443b5-08fb-41c3-b9a6-d46c0c1c3f5f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:45.454647 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-eaf443b5-08fb-41c3-b9a6-d46c0c1c3f5f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 25208 microversion: 2.20 time: 0.079815 Jul 30 16:13:45.458526 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 512/1013] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:45 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 25208 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:46.077203 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8c925cf6-1af8-4e89-a396-c133b1c25548 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1622793795", "imageRef": "eea29a7d-10c3-489a-adee-10be2e7a26bd", "flavorRef": "452"}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:46.150060 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.network.neutron [None req-8c925cf6-1af8-4e89-a396-c133b1c25548 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] validate_networks() for None {{(pid=107452) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:13:46.466320 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2be96c89-b366-4933-897a-24f5dbaf531e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:46.467360 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-2be96c89-b366-4933-897a-24f5dbaf531e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:46.473946 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2be96c89-b366-4933-897a-24f5dbaf531e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:46.474396 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2be96c89-b366-4933-897a-24f5dbaf531e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:46.475398 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2be96c89-b366-4933-897a-24f5dbaf531e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:46.475998 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2be96c89-b366-4933-897a-24f5dbaf531e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:46.546000 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-8c925cf6-1af8-4e89-a396-c133b1c25548 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Flavor limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:13:46.546284 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-8c925cf6-1af8-4e89-a396-c133b1c25548 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Image limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:13:46.546756 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-8c925cf6-1af8-4e89-a396-c133b1c25548 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Flavor pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:13:46.547177 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-8c925cf6-1af8-4e89-a396-c133b1c25548 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Image pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:13:46.547581 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-8c925cf6-1af8-4e89-a396-c133b1c25548 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:13:46.555636 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2be96c89-b366-4933-897a-24f5dbaf531e tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 26434 microversion: 2.20 time: 0.093174 Jul 30 16:13:46.557547 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8c925cf6-1af8-4e89-a396-c133b1c25548 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:46.558239 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8c925cf6-1af8-4e89-a396-c133b1c25548 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:46.559400 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8c925cf6-1af8-4e89-a396-c133b1c25548 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:46.560081 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8c925cf6-1af8-4e89-a396-c133b1c25548 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:46.561357 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 513/1014] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:46 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 26434 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:13:46.577755 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-8c925cf6-1af8-4e89-a396-c133b1c25548 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Getting quotas for project 0cc84d697d2b4ef89399a5fd281bbadd. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:13:46.582795 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-8c925cf6-1af8-4e89-a396-c133b1c25548 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Getting quotas for user 4b55b16d86c54d4fb6798c66cb7e3fcc and project 0cc84d697d2b4ef89399a5fd281bbadd. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:13:46.593993 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8c925cf6-1af8-4e89-a396-c133b1c25548 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Going to run 1 instances... {{(pid=107452) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:13:46.596385 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8c925cf6-1af8-4e89-a396-c133b1c25548 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] [instance: a1ef5adf-ce2c-4b66-929d-7ca382c36e02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eea29a7d-10c3-489a-adee-10be2e7a26bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:13:46.639562 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8c925cf6-1af8-4e89-a396-c133b1c25548 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567142 Jul 30 16:13:46.640200 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 502/1015] 10.222.0.37 () {60 vars in 1147 bytes} [Fri Jul 30 16:13:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 16:13:46.650760 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-7edd12d1-c5bc-496a-a13f-5a5c2f59b87d tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:46.651745 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-7edd12d1-c5bc-496a-a13f-5a5c2f59b87d tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] [instance: a1ef5adf-ce2c-4b66-929d-7ca382c36e02] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:46.710394 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-7edd12d1-c5bc-496a-a13f-5a5c2f59b87d tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b55b16d86c54d4fb6798c66cb7e3fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc84d697d2b4ef89399a5fd281bbadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:46.717730 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-7edd12d1-c5bc-496a-a13f-5a5c2f59b87d tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] 10.222.0.37 "GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02" status: 200 len: 1215 microversion: 2.1 time: 0.070995 Jul 30 16:13:46.719093 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 514/1016] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:46 2021] GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:13:47.567827 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a46cbf9a-db26-4b74-a0fa-8e9257b23e78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:47.568752 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a46cbf9a-db26-4b74-a0fa-8e9257b23e78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:47.577031 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a46cbf9a-db26-4b74-a0fa-8e9257b23e78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:47.577489 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a46cbf9a-db26-4b74-a0fa-8e9257b23e78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:47.578272 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a46cbf9a-db26-4b74-a0fa-8e9257b23e78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:47.578707 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a46cbf9a-db26-4b74-a0fa-8e9257b23e78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:47.660590 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a46cbf9a-db26-4b74-a0fa-8e9257b23e78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 27251 microversion: 2.20 time: 0.096350 Jul 30 16:13:47.664462 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 503/1017] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:47 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 27251 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:47.735345 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f634f75a-ce0b-46c9-b2ce-3f40b422c568 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:47.735960 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f634f75a-ce0b-46c9-b2ce-3f40b422c568 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] [instance: a1ef5adf-ce2c-4b66-929d-7ca382c36e02] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:47.743784 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f634f75a-ce0b-46c9-b2ce-3f40b422c568 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:47.744356 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f634f75a-ce0b-46c9-b2ce-3f40b422c568 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:47.745375 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f634f75a-ce0b-46c9-b2ce-3f40b422c568 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:47.745914 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f634f75a-ce0b-46c9-b2ce-3f40b422c568 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:47.810618 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f634f75a-ce0b-46c9-b2ce-3f40b422c568 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b55b16d86c54d4fb6798c66cb7e3fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc84d697d2b4ef89399a5fd281bbadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:47.818883 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f634f75a-ce0b-46c9-b2ce-3f40b422c568 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] 10.222.0.37 "GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02" status: 200 len: 1285 microversion: 2.1 time: 0.087376 Jul 30 16:13:47.823672 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 515/1018] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:47 2021] GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02 => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:48.674916 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-25e72e2b-758c-49af-88e6-7a3d39a3b626 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:48.676964 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-25e72e2b-758c-49af-88e6-7a3d39a3b626 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:48.684414 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-25e72e2b-758c-49af-88e6-7a3d39a3b626 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:48.685511 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-25e72e2b-758c-49af-88e6-7a3d39a3b626 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:48.686846 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-25e72e2b-758c-49af-88e6-7a3d39a3b626 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:48.687514 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-25e72e2b-758c-49af-88e6-7a3d39a3b626 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:48.765513 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-25e72e2b-758c-49af-88e6-7a3d39a3b626 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 27753 microversion: 2.20 time: 0.097254 Jul 30 16:13:48.766260 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 504/1019] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:48 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 27753 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:48.839464 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-969b3407-84a6-4299-9716-3e3940c69a1a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:48.840082 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-969b3407-84a6-4299-9716-3e3940c69a1a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] [instance: a1ef5adf-ce2c-4b66-929d-7ca382c36e02] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:48.846220 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-969b3407-84a6-4299-9716-3e3940c69a1a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:48.846680 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-969b3407-84a6-4299-9716-3e3940c69a1a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:48.847502 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-969b3407-84a6-4299-9716-3e3940c69a1a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:48.847940 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-969b3407-84a6-4299-9716-3e3940c69a1a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:49.063000 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-969b3407-84a6-4299-9716-3e3940c69a1a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b55b16d86c54d4fb6798c66cb7e3fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc84d697d2b4ef89399a5fd281bbadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:49.070623 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-969b3407-84a6-4299-9716-3e3940c69a1a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] 10.222.0.37 "GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02" status: 200 len: 1315 microversion: 2.1 time: 0.234821 Jul 30 16:13:49.071347 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 516/1020] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:48 2021] GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:49.720638 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-029d27e6-bc6b-4b24-8a56-41fa5f9c579d req-5009a15b-f583-4033-9f82-b0d5b9455ecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1ef5adf-ce2c-4b66-929d-7ca382c36e02", "tag": "a25b83d1-d71f-4286-afcc-c0a20c842fe9"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:49.734139 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:13:49.734139 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:13:49.749610 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-029d27e6-bc6b-4b24-8a56-41fa5f9c579d req-5009a15b-f583-4033-9f82-b0d5b9455ecb service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:49.750080 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-029d27e6-bc6b-4b24-8a56-41fa5f9c579d req-5009a15b-f583-4033-9f82-b0d5b9455ecb service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:49.763684 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-029d27e6-bc6b-4b24-8a56-41fa5f9c579d req-5009a15b-f583-4033-9f82-b0d5b9455ecb service nova] Creating event network-changed:a25b83d1-d71f-4286-afcc-c0a20c842fe9 for instance a1ef5adf-ce2c-4b66-929d-7ca382c36e02 on hv-cinder-80304 Jul 30 16:13:49.768615 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-029d27e6-bc6b-4b24-8a56-41fa5f9c579d req-5009a15b-f583-4033-9f82-b0d5b9455ecb service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056868 Jul 30 16:13:49.770373 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 505/1021] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:13:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:13:49.778555 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-213dc583-532d-4b8f-9b2c-1e36a2f85c2b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:49.779570 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-213dc583-532d-4b8f-9b2c-1e36a2f85c2b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:49.786417 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-213dc583-532d-4b8f-9b2c-1e36a2f85c2b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:49.786871 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-213dc583-532d-4b8f-9b2c-1e36a2f85c2b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:49.787697 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-213dc583-532d-4b8f-9b2c-1e36a2f85c2b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:49.788134 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-213dc583-532d-4b8f-9b2c-1e36a2f85c2b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:49.870483 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-213dc583-532d-4b8f-9b2c-1e36a2f85c2b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 28173 microversion: 2.20 time: 0.096225 Jul 30 16:13:49.873870 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 517/1022] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:49 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 28173 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:50.088229 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9de231ae-59a6-40ce-953e-d1b15deca52b tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:50.088945 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9de231ae-59a6-40ce-953e-d1b15deca52b tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] [instance: a1ef5adf-ce2c-4b66-929d-7ca382c36e02] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:50.095513 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9de231ae-59a6-40ce-953e-d1b15deca52b tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:50.095956 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9de231ae-59a6-40ce-953e-d1b15deca52b tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:50.096911 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9de231ae-59a6-40ce-953e-d1b15deca52b tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:50.097339 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9de231ae-59a6-40ce-953e-d1b15deca52b tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:50.292878 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9de231ae-59a6-40ce-953e-d1b15deca52b tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b55b16d86c54d4fb6798c66cb7e3fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc84d697d2b4ef89399a5fd281bbadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:50.300739 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9de231ae-59a6-40ce-953e-d1b15deca52b tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] 10.222.0.37 "GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02" status: 200 len: 1315 microversion: 2.1 time: 0.216360 Jul 30 16:13:50.301315 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 506/1023] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:50 2021] GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:50.884336 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-236207d1-d71c-4516-93e2-9f9155fc8092 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:50.885053 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-236207d1-d71c-4516-93e2-9f9155fc8092 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:50.892246 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-236207d1-d71c-4516-93e2-9f9155fc8092 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:50.892697 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-236207d1-d71c-4516-93e2-9f9155fc8092 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:50.893481 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-236207d1-d71c-4516-93e2-9f9155fc8092 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:50.893929 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-236207d1-d71c-4516-93e2-9f9155fc8092 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:50.967124 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-236207d1-d71c-4516-93e2-9f9155fc8092 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 28173 microversion: 2.20 time: 0.086976 Jul 30 16:13:50.967785 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 518/1024] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:50 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 28173 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:51.317345 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3087448c-4a61-411a-aa30-a3c32fd2c155 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:51.318479 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3087448c-4a61-411a-aa30-a3c32fd2c155 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] [instance: a1ef5adf-ce2c-4b66-929d-7ca382c36e02] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:51.324994 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3087448c-4a61-411a-aa30-a3c32fd2c155 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:51.325517 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3087448c-4a61-411a-aa30-a3c32fd2c155 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:51.326351 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3087448c-4a61-411a-aa30-a3c32fd2c155 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:51.326947 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3087448c-4a61-411a-aa30-a3c32fd2c155 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:51.450404 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-3087448c-4a61-411a-aa30-a3c32fd2c155 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b55b16d86c54d4fb6798c66cb7e3fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc84d697d2b4ef89399a5fd281bbadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:51.457682 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3087448c-4a61-411a-aa30-a3c32fd2c155 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] 10.222.0.37 "GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02" status: 200 len: 1315 microversion: 2.1 time: 0.143914 Jul 30 16:13:51.458249 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 507/1025] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:51 2021] GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:51.979290 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-85b0e86a-520e-478f-ae6e-9c0310564317 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:51.980292 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-85b0e86a-520e-478f-ae6e-9c0310564317 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:51.987903 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-85b0e86a-520e-478f-ae6e-9c0310564317 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:51.988353 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-85b0e86a-520e-478f-ae6e-9c0310564317 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:51.989134 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-85b0e86a-520e-478f-ae6e-9c0310564317 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:51.989568 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-85b0e86a-520e-478f-ae6e-9c0310564317 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:52.063587 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-85b0e86a-520e-478f-ae6e-9c0310564317 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 28426 microversion: 2.20 time: 0.088130 Jul 30 16:13:52.064245 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 519/1026] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:51 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 28426 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:52.474137 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6ab9f9fe-7f66-46c8-b975-388512470b4a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:52.474818 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6ab9f9fe-7f66-46c8-b975-388512470b4a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] [instance: a1ef5adf-ce2c-4b66-929d-7ca382c36e02] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:52.481526 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6ab9f9fe-7f66-46c8-b975-388512470b4a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:52.482293 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6ab9f9fe-7f66-46c8-b975-388512470b4a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:52.483437 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6ab9f9fe-7f66-46c8-b975-388512470b4a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:52.484152 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6ab9f9fe-7f66-46c8-b975-388512470b4a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:52.766554 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6ab9f9fe-7f66-46c8-b975-388512470b4a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b55b16d86c54d4fb6798c66cb7e3fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc84d697d2b4ef89399a5fd281bbadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:52.775313 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6ab9f9fe-7f66-46c8-b975-388512470b4a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] 10.222.0.37 "GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02" status: 200 len: 1315 microversion: 2.1 time: 0.304845 Jul 30 16:13:52.776593 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 508/1027] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:52 2021] GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:53.083768 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-56c20b82-a4a6-4dc4-92a7-f0e17eb318ca tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:53.084851 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-56c20b82-a4a6-4dc4-92a7-f0e17eb318ca tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:53.097038 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56c20b82-a4a6-4dc4-92a7-f0e17eb318ca tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:53.097500 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56c20b82-a4a6-4dc4-92a7-f0e17eb318ca tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:53.098847 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56c20b82-a4a6-4dc4-92a7-f0e17eb318ca tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:53.104382 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56c20b82-a4a6-4dc4-92a7-f0e17eb318ca tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:53.198475 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-56c20b82-a4a6-4dc4-92a7-f0e17eb318ca tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 28632 microversion: 2.20 time: 0.126019 Jul 30 16:13:53.203576 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 520/1028] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:53 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 28632 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:53.794628 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9a52d0cd-f084-4b79-bd5f-c6c952adc47e tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:53.795920 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9a52d0cd-f084-4b79-bd5f-c6c952adc47e tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] [instance: a1ef5adf-ce2c-4b66-929d-7ca382c36e02] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:53.802974 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9a52d0cd-f084-4b79-bd5f-c6c952adc47e tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:53.803709 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9a52d0cd-f084-4b79-bd5f-c6c952adc47e tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:53.810811 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9a52d0cd-f084-4b79-bd5f-c6c952adc47e tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:53.811560 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9a52d0cd-f084-4b79-bd5f-c6c952adc47e tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:53.961877 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9a52d0cd-f084-4b79-bd5f-c6c952adc47e tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b55b16d86c54d4fb6798c66cb7e3fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc84d697d2b4ef89399a5fd281bbadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:53.969820 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9a52d0cd-f084-4b79-bd5f-c6c952adc47e tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] 10.222.0.37 "GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02" status: 200 len: 1315 microversion: 2.1 time: 0.179674 Jul 30 16:13:53.970616 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 509/1029] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:53 2021] GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:54.212212 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f8ff4b4e-296d-437a-a9f8-d938190ca8bf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:54.213417 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f8ff4b4e-296d-437a-a9f8-d938190ca8bf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:54.223430 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f8ff4b4e-296d-437a-a9f8-d938190ca8bf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:54.224169 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f8ff4b4e-296d-437a-a9f8-d938190ca8bf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:54.225506 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f8ff4b4e-296d-437a-a9f8-d938190ca8bf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:54.226118 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f8ff4b4e-296d-437a-a9f8-d938190ca8bf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:54.299407 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f8ff4b4e-296d-437a-a9f8-d938190ca8bf tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 28632 microversion: 2.20 time: 0.091278 Jul 30 16:13:54.300326 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 521/1030] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:54 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 28632 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:54.986465 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-873dc4e9-875d-46cd-9567-cbabc3042c4b tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:54.987069 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-873dc4e9-875d-46cd-9567-cbabc3042c4b tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] [instance: a1ef5adf-ce2c-4b66-929d-7ca382c36e02] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:54.993080 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-873dc4e9-875d-46cd-9567-cbabc3042c4b tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:54.993521 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-873dc4e9-875d-46cd-9567-cbabc3042c4b tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:54.994290 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-873dc4e9-875d-46cd-9567-cbabc3042c4b tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:54.994716 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-873dc4e9-875d-46cd-9567-cbabc3042c4b tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:55.154543 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-873dc4e9-875d-46cd-9567-cbabc3042c4b tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b55b16d86c54d4fb6798c66cb7e3fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc84d697d2b4ef89399a5fd281bbadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:55.164169 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-873dc4e9-875d-46cd-9567-cbabc3042c4b tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] 10.222.0.37 "GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02" status: 200 len: 1315 microversion: 2.1 time: 0.181252 Jul 30 16:13:55.164889 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 510/1031] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:54 2021] GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:55.313171 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3c10058a-55b9-411f-a361-8938afafb6b2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:55.315797 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-3c10058a-55b9-411f-a361-8938afafb6b2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:55.325520 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3c10058a-55b9-411f-a361-8938afafb6b2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:55.326408 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3c10058a-55b9-411f-a361-8938afafb6b2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:55.327379 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3c10058a-55b9-411f-a361-8938afafb6b2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:55.327965 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3c10058a-55b9-411f-a361-8938afafb6b2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:55.398567 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-3c10058a-55b9-411f-a361-8938afafb6b2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 28632 microversion: 2.20 time: 0.090393 Jul 30 16:13:55.399949 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 522/1032] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:55 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 28632 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:55.594978 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-8068f616-331b-4e57-828b-1bbd15a18b92 req-3c77fc7c-c6ea-49cb-9e40-cc86655cf261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ef5adf-ce2c-4b66-929d-7ca382c36e02", "name": "network-vif-plugged", "status": "completed", "tag": "a25b83d1-d71f-4286-afcc-c0a20c842fe9"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:55.596798 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:13:55.596798 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:13:55.604990 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-8068f616-331b-4e57-828b-1bbd15a18b92 req-3c77fc7c-c6ea-49cb-9e40-cc86655cf261 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:55.605800 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-8068f616-331b-4e57-828b-1bbd15a18b92 req-3c77fc7c-c6ea-49cb-9e40-cc86655cf261 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:55.618765 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-8068f616-331b-4e57-828b-1bbd15a18b92 req-3c77fc7c-c6ea-49cb-9e40-cc86655cf261 service nova] Creating event network-vif-plugged:a25b83d1-d71f-4286-afcc-c0a20c842fe9 for instance a1ef5adf-ce2c-4b66-929d-7ca382c36e02 on hv-cinder-80304 Jul 30 16:13:55.628229 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-8068f616-331b-4e57-828b-1bbd15a18b92 req-3c77fc7c-c6ea-49cb-9e40-cc86655cf261 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036760 Jul 30 16:13:55.629083 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 511/1033] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:13:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:13:56.182048 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1e79bda3-9f53-41cb-a2c5-b7c23703e214 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:56.182739 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1e79bda3-9f53-41cb-a2c5-b7c23703e214 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] [instance: a1ef5adf-ce2c-4b66-929d-7ca382c36e02] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:56.192521 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1e79bda3-9f53-41cb-a2c5-b7c23703e214 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:56.193214 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1e79bda3-9f53-41cb-a2c5-b7c23703e214 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:56.194161 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1e79bda3-9f53-41cb-a2c5-b7c23703e214 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:56.194780 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1e79bda3-9f53-41cb-a2c5-b7c23703e214 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:56.406322 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1e79bda3-9f53-41cb-a2c5-b7c23703e214 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b55b16d86c54d4fb6798c66cb7e3fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc84d697d2b4ef89399a5fd281bbadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:56.414653 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1dee0ae4-9d31-4715-81ae-dff72ad032de tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:56.416423 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1dee0ae4-9d31-4715-81ae-dff72ad032de tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:56.422292 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1e79bda3-9f53-41cb-a2c5-b7c23703e214 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] 10.222.0.37 "GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02" status: 200 len: 1315 microversion: 2.1 time: 0.244159 Jul 30 16:13:56.423028 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 523/1034] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:56 2021] GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:56.431947 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1dee0ae4-9d31-4715-81ae-dff72ad032de tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:56.432794 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1dee0ae4-9d31-4715-81ae-dff72ad032de tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:56.433757 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1dee0ae4-9d31-4715-81ae-dff72ad032de tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:56.434623 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1dee0ae4-9d31-4715-81ae-dff72ad032de tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:56.526600 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1dee0ae4-9d31-4715-81ae-dff72ad032de tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 28632 microversion: 2.20 time: 0.111064 Jul 30 16:13:56.535475 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 512/1035] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:56 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 28632 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:57.441675 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-43965dc7-3461-4c83-8061-82c10006f43f tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:57.443492 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-43965dc7-3461-4c83-8061-82c10006f43f tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] [instance: a1ef5adf-ce2c-4b66-929d-7ca382c36e02] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:57.459269 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-43965dc7-3461-4c83-8061-82c10006f43f tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:57.460352 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-43965dc7-3461-4c83-8061-82c10006f43f tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:57.461573 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-43965dc7-3461-4c83-8061-82c10006f43f tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:57.462394 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-43965dc7-3461-4c83-8061-82c10006f43f tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:57.547809 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-cb0c25c3-6181-4844-8aaf-5d559e11725b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:57.549365 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-cb0c25c3-6181-4844-8aaf-5d559e11725b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:57.556280 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cb0c25c3-6181-4844-8aaf-5d559e11725b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:57.557303 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cb0c25c3-6181-4844-8aaf-5d559e11725b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:57.558260 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cb0c25c3-6181-4844-8aaf-5d559e11725b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:57.558945 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cb0c25c3-6181-4844-8aaf-5d559e11725b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:57.657607 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-cb0c25c3-6181-4844-8aaf-5d559e11725b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 29994 microversion: 2.20 time: 0.115402 Jul 30 16:13:57.659314 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 513/1036] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:57 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 29994 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:57.664416 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ff700538-3d74-4974-8bcb-e8d74d8d897f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:57.667227 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ff700538-3d74-4974-8bcb-e8d74d8d897f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:57.677362 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-43965dc7-3461-4c83-8061-82c10006f43f tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b55b16d86c54d4fb6798c66cb7e3fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc84d697d2b4ef89399a5fd281bbadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:57.683565 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ff700538-3d74-4974-8bcb-e8d74d8d897f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:57.684777 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ff700538-3d74-4974-8bcb-e8d74d8d897f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:57.684922 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-43965dc7-3461-4c83-8061-82c10006f43f tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] 10.222.0.37 "GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02" status: 200 len: 1465 microversion: 2.1 time: 0.247857 Jul 30 16:13:57.685843 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 524/1037] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:57 2021] GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02 => generated 1465 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:57.686545 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ff700538-3d74-4974-8bcb-e8d74d8d897f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:57.687105 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ff700538-3d74-4974-8bcb-e8d74d8d897f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:57.725640 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ff700538-3d74-4974-8bcb-e8d74d8d897f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Going to try to terminate instance {{(pid=107452) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:13:57.738609 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3d86b510-cd10-4fdf-ba82-1f873c7d6550 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:57.738609 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-3d86b510-cd10-4fdf-ba82-1f873c7d6550 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] [instance: a1ef5adf-ce2c-4b66-929d-7ca382c36e02] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:57.743939 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3d86b510-cd10-4fdf-ba82-1f873c7d6550 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:57.744451 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3d86b510-cd10-4fdf-ba82-1f873c7d6550 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:57.748265 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3d86b510-cd10-4fdf-ba82-1f873c7d6550 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:57.748924 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3d86b510-cd10-4fdf-ba82-1f873c7d6550 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:57.795108 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-3d86b510-cd10-4fdf-ba82-1f873c7d6550 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] [instance: a1ef5adf-ce2c-4b66-929d-7ca382c36e02] Going to try to terminate instance {{(pid=107453) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:13:57.858352 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ff700538-3d74-4974-8bcb-e8d74d8d897f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "DELETE /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 204 len: 0 microversion: 2.1 time: 0.197446 Jul 30 16:13:57.859440 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 514/1038] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:13:57 2021] DELETE /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 16:13:57.876006 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a20967f7-91a6-49b1-90c6-417c224d6e4a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:57.876006 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a20967f7-91a6-49b1-90c6-417c224d6e4a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:57.882385 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a20967f7-91a6-49b1-90c6-417c224d6e4a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:57.883741 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a20967f7-91a6-49b1-90c6-417c224d6e4a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:57.883967 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a20967f7-91a6-49b1-90c6-417c224d6e4a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:57.884372 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a20967f7-91a6-49b1-90c6-417c224d6e4a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:57.935359 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-3d86b510-cd10-4fdf-ba82-1f873c7d6550 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] 10.222.0.37 "DELETE /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02" status: 204 len: 0 microversion: 2.1 time: 0.202197 Jul 30 16:13:57.936333 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 525/1039] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:13:57 2021] DELETE /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 16:13:57.946785 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c26e62c7-433d-4cd3-923e-bdde3f8f6876 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:57.949745 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c26e62c7-433d-4cd3-923e-bdde3f8f6876 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] [instance: a1ef5adf-ce2c-4b66-929d-7ca382c36e02] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:57.956263 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c26e62c7-433d-4cd3-923e-bdde3f8f6876 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:57.964864 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c26e62c7-433d-4cd3-923e-bdde3f8f6876 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:57.966689 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c26e62c7-433d-4cd3-923e-bdde3f8f6876 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:57.967616 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c26e62c7-433d-4cd3-923e-bdde3f8f6876 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:58.075776 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-a20967f7-91a6-49b1-90c6-417c224d6e4a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:58.084456 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a20967f7-91a6-49b1-90c6-417c224d6e4a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1671 microversion: 2.1 time: 0.220799 Jul 30 16:13:58.085203 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 515/1040] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:57 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1671 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:13:58.487815 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c26e62c7-433d-4cd3-923e-bdde3f8f6876 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b55b16d86c54d4fb6798c66cb7e3fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc84d697d2b4ef89399a5fd281bbadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:58.499162 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c26e62c7-433d-4cd3-923e-bdde3f8f6876 tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] 10.222.0.37 "GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02" status: 200 len: 1471 microversion: 2.1 time: 0.558426 Jul 30 16:13:58.499924 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 526/1041] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:57 2021] GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02 => generated 1471 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:13:58.670546 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-2435836a-2d45-4d6f-870d-be4d550a5cc0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:58.671494 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-2435836a-2d45-4d6f-870d-be4d550a5cc0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:58.681027 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2435836a-2d45-4d6f-870d-be4d550a5cc0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:58.681473 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2435836a-2d45-4d6f-870d-be4d550a5cc0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:58.684677 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2435836a-2d45-4d6f-870d-be4d550a5cc0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:58.687072 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2435836a-2d45-4d6f-870d-be4d550a5cc0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:58.800921 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-2435836a-2d45-4d6f-870d-be4d550a5cc0 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 31431 microversion: 2.20 time: 0.134924 Jul 30 16:13:58.802046 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 516/1042] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:58 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 31431 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:13:59.102937 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9b0dd622-2f7c-4db8-9d73-7a2838de3582 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:59.103811 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9b0dd622-2f7c-4db8-9d73-7a2838de3582 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:59.114089 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9b0dd622-2f7c-4db8-9d73-7a2838de3582 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:59.114793 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9b0dd622-2f7c-4db8-9d73-7a2838de3582 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:59.115764 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9b0dd622-2f7c-4db8-9d73-7a2838de3582 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:59.116340 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9b0dd622-2f7c-4db8-9d73-7a2838de3582 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:59.396665 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9b0dd622-2f7c-4db8-9d73-7a2838de3582 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:59.406470 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9b0dd622-2f7c-4db8-9d73-7a2838de3582 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1671 microversion: 2.1 time: 0.307133 Jul 30 16:13:59.415558 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 527/1043] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:59 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1671 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:59.518736 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3817c789-f495-48b5-803c-a074726e086d tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:13:59.519762 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3817c789-f495-48b5-803c-a074726e086d tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] [instance: a1ef5adf-ce2c-4b66-929d-7ca382c36e02] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:59.528685 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3817c789-f495-48b5-803c-a074726e086d tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:59.529368 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3817c789-f495-48b5-803c-a074726e086d tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:59.530322 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3817c789-f495-48b5-803c-a074726e086d tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:59.530915 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3817c789-f495-48b5-803c-a074726e086d tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:59.816953 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-3817c789-f495-48b5-803c-a074726e086d tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b55b16d86c54d4fb6798c66cb7e3fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc84d697d2b4ef89399a5fd281bbadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:13:59.824195 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-784fdf49-78f5-4ae1-8f99-48dca973d1d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:13:59.827569 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-784fdf49-78f5-4ae1-8f99-48dca973d1d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:13:59.841491 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3817c789-f495-48b5-803c-a074726e086d tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] 10.222.0.37 "GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02" status: 200 len: 1471 microversion: 2.1 time: 0.324805 Jul 30 16:13:59.845392 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 517/1044] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:13:59 2021] GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02 => generated 1471 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:13:59.856532 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-784fdf49-78f5-4ae1-8f99-48dca973d1d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:59.856943 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-784fdf49-78f5-4ae1-8f99-48dca973d1d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:59.857850 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-784fdf49-78f5-4ae1-8f99-48dca973d1d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:13:59.858286 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-784fdf49-78f5-4ae1-8f99-48dca973d1d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:13:59.958584 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-784fdf49-78f5-4ae1-8f99-48dca973d1d3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 32907 microversion: 2.20 time: 0.148428 Jul 30 16:13:59.959954 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 528/1045] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:13:59 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 32907 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:14:00.391844 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-0070ef24-b997-4bd7-9990-6ef03bd25775 req-ac1a5467-9dac-41eb-af28-dbc4086baf85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd5216c-577d-42c9-a471-a99a85090a20", "name": "network-vif-deleted", "tag": "bad8026f-4849-4e27-85b3-69b75386ebbf"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:00.394403 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:14:00.394403 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:14:00.405785 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-0070ef24-b997-4bd7-9990-6ef03bd25775 req-ac1a5467-9dac-41eb-af28-dbc4086baf85 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:00.407838 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-0070ef24-b997-4bd7-9990-6ef03bd25775 req-ac1a5467-9dac-41eb-af28-dbc4086baf85 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:00.427937 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-446749da-944f-41e3-b7e4-ee6cd3777f2f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:00.428896 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-446749da-944f-41e3-b7e4-ee6cd3777f2f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:00.435967 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-0070ef24-b997-4bd7-9990-6ef03bd25775 req-ac1a5467-9dac-41eb-af28-dbc4086baf85 service nova] Creating event network-vif-deleted:bad8026f-4849-4e27-85b3-69b75386ebbf for instance dbd5216c-577d-42c9-a471-a99a85090a20 on hv-cinder-80304 Jul 30 16:14:00.441367 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-0070ef24-b997-4bd7-9990-6ef03bd25775 req-ac1a5467-9dac-41eb-af28-dbc4086baf85 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054232 Jul 30 16:14:00.442462 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-446749da-944f-41e3-b7e4-ee6cd3777f2f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:00.443110 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-446749da-944f-41e3-b7e4-ee6cd3777f2f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:00.443922 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 518/1046] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:14:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:14:00.444466 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-446749da-944f-41e3-b7e4-ee6cd3777f2f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:00.445389 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-446749da-944f-41e3-b7e4-ee6cd3777f2f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:00.649162 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-446749da-944f-41e3-b7e4-ee6cd3777f2f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:00.663580 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-446749da-944f-41e3-b7e4-ee6cd3777f2f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 200 len: 1321 microversion: 2.1 time: 0.240287 Jul 30 16:14:00.665435 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 529/1047] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:00 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:14:00.863855 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-901a652b-3771-4521-bd62-f661b09f4bdf tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:00.865200 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-901a652b-3771-4521-bd62-f661b09f4bdf tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] [instance: a1ef5adf-ce2c-4b66-929d-7ca382c36e02] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:00.882850 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-901a652b-3771-4521-bd62-f661b09f4bdf tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:00.886127 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-901a652b-3771-4521-bd62-f661b09f4bdf tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:00.888947 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-901a652b-3771-4521-bd62-f661b09f4bdf tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:00.890896 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-901a652b-3771-4521-bd62-f661b09f4bdf tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:00.960433 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-2cec8771-72d6-41fd-9b3b-f38d722eab8d req-ea8b018b-46aa-4c2e-8de0-17d2d6978ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ef5adf-ce2c-4b66-929d-7ca382c36e02", "name": "network-vif-deleted", "tag": "a25b83d1-d71f-4286-afcc-c0a20c842fe9"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:00.971156 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:14:00.971156 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:14:00.995298 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-2cec8771-72d6-41fd-9b3b-f38d722eab8d req-ea8b018b-46aa-4c2e-8de0-17d2d6978ee9 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:00.996942 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-2cec8771-72d6-41fd-9b3b-f38d722eab8d req-ea8b018b-46aa-4c2e-8de0-17d2d6978ee9 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:01.038605 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-2cec8771-72d6-41fd-9b3b-f38d722eab8d req-ea8b018b-46aa-4c2e-8de0-17d2d6978ee9 service nova] Creating event network-vif-deleted:a25b83d1-d71f-4286-afcc-c0a20c842fe9 for instance a1ef5adf-ce2c-4b66-929d-7ca382c36e02 on hv-cinder-80304 Jul 30 16:14:01.049983 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-901a652b-3771-4521-bd62-f661b09f4bdf tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b55b16d86c54d4fb6798c66cb7e3fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc84d697d2b4ef89399a5fd281bbadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:01.050195 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-2cec8771-72d6-41fd-9b3b-f38d722eab8d req-ea8b018b-46aa-4c2e-8de0-17d2d6978ee9 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093381 Jul 30 16:14:01.052808 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 530/1048] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:14:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:14:01.062390 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-901a652b-3771-4521-bd62-f661b09f4bdf tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] 10.222.0.37 "GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02" status: 200 len: 1429 microversion: 2.1 time: 0.203798 Jul 30 16:14:01.063654 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 519/1049] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:00 2021] GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02 => generated 1429 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:01.072227 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8ccbd140-c64d-4771-ac56-d4ac6a9d958b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:01.079066 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-8ccbd140-c64d-4771-ac56-d4ac6a9d958b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:01.105160 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8ccbd140-c64d-4771-ac56-d4ac6a9d958b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:01.106369 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8ccbd140-c64d-4771-ac56-d4ac6a9d958b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:01.107463 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8ccbd140-c64d-4771-ac56-d4ac6a9d958b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:01.108740 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8ccbd140-c64d-4771-ac56-d4ac6a9d958b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:01.220519 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8ccbd140-c64d-4771-ac56-d4ac6a9d958b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 33897 microversion: 2.20 time: 0.161995 Jul 30 16:14:01.221175 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 531/1050] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:14:01 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 33897 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:14:01.681282 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8d1eb163-84d3-4448-ac54-2b2139d56f6f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:01.682248 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8d1eb163-84d3-4448-ac54-2b2139d56f6f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:01.693725 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8d1eb163-84d3-4448-ac54-2b2139d56f6f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:01.694666 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8d1eb163-84d3-4448-ac54-2b2139d56f6f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:01.696035 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8d1eb163-84d3-4448-ac54-2b2139d56f6f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:01.696614 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8d1eb163-84d3-4448-ac54-2b2139d56f6f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:01.722851 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-8d1eb163-84d3-4448-ac54-2b2139d56f6f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] HTTP exception thrown: Instance dbd5216c-577d-42c9-a471-a99a85090a20 could not be found. Jul 30 16:14:01.732395 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8d1eb163-84d3-4448-ac54-2b2139d56f6f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Returning 404 to user: Instance dbd5216c-577d-42c9-a471-a99a85090a20 could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:14:01.733532 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8d1eb163-84d3-4448-ac54-2b2139d56f6f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 404 len: 111 microversion: 2.1 time: 0.056056 Jul 30 16:14:01.734637 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 520/1051] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:01 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:14:01.743542 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-48c6dcf9-e5ec-4307-901b-30e93f30dbe8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '.version_select at 0x7fb17e911f70>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:01.797626 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-48c6dcf9-e5ec-4307-901b-30e93f30dbe8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-547123597" status: 202 len: 0 microversion: 2.1 time: 0.058510 Jul 30 16:14:01.798794 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 532/1052] 10.222.0.37 () {58 vars in 1218 bytes} [Fri Jul 30 16:14:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-547123597 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:14:02.081419 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-092cc047-4231-4f59-9597-d58ea838166a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:02.082015 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-092cc047-4231-4f59-9597-d58ea838166a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] [instance: a1ef5adf-ce2c-4b66-929d-7ca382c36e02] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:02.098084 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-092cc047-4231-4f59-9597-d58ea838166a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:02.098514 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-092cc047-4231-4f59-9597-d58ea838166a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:02.111613 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-092cc047-4231-4f59-9597-d58ea838166a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:02.112446 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-092cc047-4231-4f59-9597-d58ea838166a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:02.156194 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-092cc047-4231-4f59-9597-d58ea838166a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] HTTP exception thrown: Instance a1ef5adf-ce2c-4b66-929d-7ca382c36e02 could not be found. Jul 30 16:14:02.157035 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-092cc047-4231-4f59-9597-d58ea838166a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] Returning 404 to user: Instance a1ef5adf-ce2c-4b66-929d-7ca382c36e02 could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:14:02.158113 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-092cc047-4231-4f59-9597-d58ea838166a tempest-VolumesNegativeTest-1251111704 tempest-VolumesNegativeTest-1251111704-project] 10.222.0.37 "GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02" status: 404 len: 111 microversion: 2.1 time: 0.081989 Jul 30 16:14:02.165755 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 521/1053] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:02 2021] GET /compute/v2.1/servers/a1ef5adf-ce2c-4b66-929d-7ca382c36e02 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:14:02.233481 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-941dcbd1-6914-444e-a3cf-0f26132dd46d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:02.235176 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-941dcbd1-6914-444e-a3cf-0f26132dd46d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:02.249630 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-941dcbd1-6914-444e-a3cf-0f26132dd46d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:02.251655 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-941dcbd1-6914-444e-a3cf-0f26132dd46d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:02.252681 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-941dcbd1-6914-444e-a3cf-0f26132dd46d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:02.254877 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-941dcbd1-6914-444e-a3cf-0f26132dd46d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:02.378341 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-941dcbd1-6914-444e-a3cf-0f26132dd46d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 35118 microversion: 2.20 time: 0.148623 Jul 30 16:14:02.379749 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 533/1054] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:14:02 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 35118 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:14:02.645918 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-227a1a1a-5bef-4b4e-8c74-c7fdb98f2bca tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Action: 'create', calling method: .version_select at 0x7fb17eab43a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2065592267"}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:02.678077 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-227a1a1a-5bef-4b4e-8c74-c7fdb98f2bca tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Getting quotas for project 07bf3493a71648c895b14d999b3bfb1e. Resources: {'key_pairs'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:14:02.682651 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-227a1a1a-5bef-4b4e-8c74-c7fdb98f2bca tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Getting quotas for user ea3885b43f9a4d32aab4abebece046c8 and project 07bf3493a71648c895b14d999b3bfb1e. Resources: {'key_pairs'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:14:03.326290 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-227a1a1a-5bef-4b4e-8c74-c7fdb98f2bca tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Getting quotas for project 07bf3493a71648c895b14d999b3bfb1e. Resources: {'key_pairs'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:14:03.330606 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-227a1a1a-5bef-4b4e-8c74-c7fdb98f2bca tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Getting quotas for user ea3885b43f9a4d32aab4abebece046c8 and project 07bf3493a71648c895b14d999b3bfb1e. Resources: {'key_pairs'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:14:03.345247 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-227a1a1a-5bef-4b4e-8c74-c7fdb98f2bca tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.000002 Jul 30 16:14:03.346180 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 522/1055] 10.222.0.37 () {60 vars in 1158 bytes} [Fri Jul 30 16:14:02 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:03.394565 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0722a5bc-b396-4abc-9573-e1ecc2990923 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:03.397639 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0722a5bc-b396-4abc-9573-e1ecc2990923 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:03.406197 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0722a5bc-b396-4abc-9573-e1ecc2990923 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:03.407221 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0722a5bc-b396-4abc-9573-e1ecc2990923 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:03.410026 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0722a5bc-b396-4abc-9573-e1ecc2990923 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:03.410956 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0722a5bc-b396-4abc-9573-e1ecc2990923 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:03.512402 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-db2f9c2f-4775-45ff-94a0-f7d4e6caef12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'create', calling method: .version_select at 0x7fb17ea72b80>, body: {"keypair": {"name": "tempest-keypair-396818474"}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:03.517670 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0722a5bc-b396-4abc-9573-e1ecc2990923 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 36503 microversion: 2.20 time: 0.130687 Jul 30 16:14:03.519171 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 534/1056] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:14:03 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 36503 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:14:03.538710 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-db2f9c2f-4775-45ff-94a0-f7d4e6caef12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Getting quotas for project 71bd283ed91a45de8865533d41ffec34. Resources: {'key_pairs'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:14:03.543898 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-db2f9c2f-4775-45ff-94a0-f7d4e6caef12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Getting quotas for user ab02c2f0aba54c22b96721d792ae4a69 and project 71bd283ed91a45de8865533d41ffec34. Resources: {'key_pairs'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:14:03.679286 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-db2f9c2f-4775-45ff-94a0-f7d4e6caef12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Getting quotas for project 71bd283ed91a45de8865533d41ffec34. Resources: {'key_pairs'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:14:03.683737 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-db2f9c2f-4775-45ff-94a0-f7d4e6caef12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Getting quotas for user ab02c2f0aba54c22b96721d792ae4a69 and project 71bd283ed91a45de8865533d41ffec34. Resources: {'key_pairs'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:14:03.698910 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-db2f9c2f-4775-45ff-94a0-f7d4e6caef12 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.191009 Jul 30 16:14:03.699953 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 523/1057] 10.222.0.37 () {60 vars in 1158 bytes} [Fri Jul 30 16:14:03 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:04.531088 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-74c8292b-72d9-4528-a29e-411366f56112 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:04.538060 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-74c8292b-72d9-4528-a29e-411366f56112 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:04.551174 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-74c8292b-72d9-4528-a29e-411366f56112 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:04.551829 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-74c8292b-72d9-4528-a29e-411366f56112 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:04.568884 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-74c8292b-72d9-4528-a29e-411366f56112 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:04.571982 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-74c8292b-72d9-4528-a29e-411366f56112 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:04.684408 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-74c8292b-72d9-4528-a29e-411366f56112 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 37975 microversion: 2.20 time: 0.157278 Jul 30 16:14:04.685066 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 535/1058] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:14:04 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 37975 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:14:05.696384 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-38d47d27-4735-4349-9aa2-cd4f234d1c1a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:05.697303 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-38d47d27-4735-4349-9aa2-cd4f234d1c1a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:05.709017 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-38d47d27-4735-4349-9aa2-cd4f234d1c1a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:05.709468 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-38d47d27-4735-4349-9aa2-cd4f234d1c1a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:05.710257 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-38d47d27-4735-4349-9aa2-cd4f234d1c1a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:05.710694 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-38d47d27-4735-4349-9aa2-cd4f234d1c1a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:05.828318 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-38d47d27-4735-4349-9aa2-cd4f234d1c1a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 38187 microversion: 2.20 time: 0.135545 Jul 30 16:14:05.829632 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 524/1059] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:14:05 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 38187 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:14:06.029532 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-69dd3a49-1936-43c6-9c09-cacecec21a24 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-274473704", "imageRef": "eea29a7d-10c3-489a-adee-10be2e7a26bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7bf86150-dae2-4a45-a359-67121f10c5f9"}], "security_groups": [{"name": "tempest-securitygroup--1562199844"}], "key_name": "tempest-keypair-396818474", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:06.135122 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.network.neutron [None req-69dd3a49-1936-43c6-9c09-cacecec21a24 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] validate_networks() for [('7bf86150-dae2-4a45-a359-67121f10c5f9', None, None, None)] {{(pid=107453) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:14:06.696356 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-69dd3a49-1936-43c6-9c09-cacecec21a24 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Flavor limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:14:06.697144 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-69dd3a49-1936-43c6-9c09-cacecec21a24 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Image limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:14:06.697794 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-69dd3a49-1936-43c6-9c09-cacecec21a24 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Flavor pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:14:06.698249 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-69dd3a49-1936-43c6-9c09-cacecec21a24 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Image pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:14:06.698958 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-69dd3a49-1936-43c6-9c09-cacecec21a24 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:14:06.707875 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-69dd3a49-1936-43c6-9c09-cacecec21a24 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:06.708339 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-69dd3a49-1936-43c6-9c09-cacecec21a24 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:06.709349 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-69dd3a49-1936-43c6-9c09-cacecec21a24 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:06.709788 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-69dd3a49-1936-43c6-9c09-cacecec21a24 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:06.727963 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-69dd3a49-1936-43c6-9c09-cacecec21a24 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Getting quotas for project 71bd283ed91a45de8865533d41ffec34. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:14:06.732855 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-69dd3a49-1936-43c6-9c09-cacecec21a24 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Getting quotas for user ab02c2f0aba54c22b96721d792ae4a69 and project 71bd283ed91a45de8865533d41ffec34. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:14:06.758001 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-69dd3a49-1936-43c6-9c09-cacecec21a24 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Going to run 1 instances... {{(pid=107453) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:14:06.760472 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-69dd3a49-1936-43c6-9c09-cacecec21a24 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eea29a7d-10c3-489a-adee-10be2e7a26bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:14:06.835485 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-69dd3a49-1936-43c6-9c09-cacecec21a24 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.810561 Jul 30 16:14:06.838534 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 536/1060] 10.222.0.37 () {60 vars in 1147 bytes} [Fri Jul 30 16:14:06 2021] POST /compute/v2.1/servers => generated 402 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 16:14:06.841550 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f6bfb6b5-9831-4e03-bdc0-9930a23caeff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:06.842548 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f6bfb6b5-9831-4e03-bdc0-9930a23caeff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:06.849018 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-bb625bfb-da06-453b-b192-e8c57b06208e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:06.850013 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-bb625bfb-da06-453b-b192-e8c57b06208e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:06.851182 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f6bfb6b5-9831-4e03-bdc0-9930a23caeff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:06.851797 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f6bfb6b5-9831-4e03-bdc0-9930a23caeff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:06.852769 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f6bfb6b5-9831-4e03-bdc0-9930a23caeff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:06.853349 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f6bfb6b5-9831-4e03-bdc0-9930a23caeff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:06.952351 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-bb625bfb-da06-453b-b192-e8c57b06208e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:06.964041 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f6bfb6b5-9831-4e03-bdc0-9930a23caeff tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 38187 microversion: 2.20 time: 0.127447 Jul 30 16:14:06.965725 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 525/1061] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:14:06 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 38187 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:14:06.967446 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-bb625bfb-da06-453b-b192-e8c57b06208e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f" status: 200 len: 1236 microversion: 2.1 time: 0.121940 Jul 30 16:14:06.968223 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 537/1062] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:06 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f => generated 1236 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:14:07.995073 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-52ae15c8-759d-4ada-a080-b4cb1b1ec53f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:07.997984 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-52ae15c8-759d-4ada-a080-b4cb1b1ec53f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:07.998940 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e4b0f57a-a7ac-4638-b608-19e68687e973 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:08.000229 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e4b0f57a-a7ac-4638-b608-19e68687e973 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:08.014976 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e4b0f57a-a7ac-4638-b608-19e68687e973 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:08.015470 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e4b0f57a-a7ac-4638-b608-19e68687e973 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:08.015635 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-52ae15c8-759d-4ada-a080-b4cb1b1ec53f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:08.016397 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e4b0f57a-a7ac-4638-b608-19e68687e973 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:08.016876 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e4b0f57a-a7ac-4638-b608-19e68687e973 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:08.017153 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-52ae15c8-759d-4ada-a080-b4cb1b1ec53f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:08.020801 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-52ae15c8-759d-4ada-a080-b4cb1b1ec53f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:08.023494 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-52ae15c8-759d-4ada-a080-b4cb1b1ec53f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:08.096678 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e4b0f57a-a7ac-4638-b608-19e68687e973 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 38187 microversion: 2.20 time: 0.122991 Jul 30 16:14:08.100755 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 526/1063] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:14:07 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 38187 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:14:08.125519 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-52ae15c8-759d-4ada-a080-b4cb1b1ec53f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:08.134714 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-52ae15c8-759d-4ada-a080-b4cb1b1ec53f tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f" status: 200 len: 1294 microversion: 2.1 time: 0.153975 Jul 30 16:14:08.135406 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 538/1064] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:07 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f => generated 1294 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:09.109844 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-2ecb8e3f-0631-43fd-b6eb-a08d2740094b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:09.110854 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-2ecb8e3f-0631-43fd-b6eb-a08d2740094b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:09.117401 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2ecb8e3f-0631-43fd-b6eb-a08d2740094b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:09.117941 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2ecb8e3f-0631-43fd-b6eb-a08d2740094b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:09.118716 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2ecb8e3f-0631-43fd-b6eb-a08d2740094b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:09.119169 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2ecb8e3f-0631-43fd-b6eb-a08d2740094b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:09.151600 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-64a0e2ad-dede-4de6-bb4a-246a95ea4285 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:09.152212 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-64a0e2ad-dede-4de6-bb4a-246a95ea4285 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:09.158557 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-64a0e2ad-dede-4de6-bb4a-246a95ea4285 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:09.159110 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-64a0e2ad-dede-4de6-bb4a-246a95ea4285 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:09.159802 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-64a0e2ad-dede-4de6-bb4a-246a95ea4285 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:09.160237 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-64a0e2ad-dede-4de6-bb4a-246a95ea4285 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:09.180655 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-2ecb8e3f-0631-43fd-b6eb-a08d2740094b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 200 len: 38330 microversion: 2.20 time: 0.075512 Jul 30 16:14:09.182083 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 527/1065] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:14:09 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 38330 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:14:09.193063 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-da2a6c2a-9049-4917-b63c-4a62d9eba7cb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:09.193648 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-da2a6c2a-9049-4917-b63c-4a62d9eba7cb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:09.200267 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-da2a6c2a-9049-4917-b63c-4a62d9eba7cb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:09.200715 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-da2a6c2a-9049-4917-b63c-4a62d9eba7cb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:09.201492 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-da2a6c2a-9049-4917-b63c-4a62d9eba7cb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:09.201929 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-da2a6c2a-9049-4917-b63c-4a62d9eba7cb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:09.226496 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-da2a6c2a-9049-4917-b63c-4a62d9eba7cb tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/ips" status: 200 len: 151 microversion: 2.20 time: 0.037408 Jul 30 16:14:09.232593 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 528/1066] 10.222.0.37 () {60 vars in 1289 bytes} [Fri Jul 30 16:14:09 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:14:09.380042 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-64a0e2ad-dede-4de6-bb4a-246a95ea4285 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:09.388972 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-64a0e2ad-dede-4de6-bb4a-246a95ea4285 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f" status: 200 len: 1362 microversion: 2.1 time: 0.240789 Jul 30 16:14:09.398718 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 539/1067] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:09 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:14:09.562897 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-7f425602-1517-4091-9b5a-43fb1c66ccbf req-fd763c20-0a62-418d-bbf8-16b2619f1b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73763b31-8f9b-4de3-869a-0e9dc418231f", "tag": "85ee21b6-2ddd-43b1-b8f4-2677b088a5b8"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:09.564480 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:14:09.564480 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:14:09.579151 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-7f425602-1517-4091-9b5a-43fb1c66ccbf req-fd763c20-0a62-418d-bbf8-16b2619f1b0c service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:09.579894 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-7f425602-1517-4091-9b5a-43fb1c66ccbf req-fd763c20-0a62-418d-bbf8-16b2619f1b0c service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:09.592561 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-7f425602-1517-4091-9b5a-43fb1c66ccbf req-fd763c20-0a62-418d-bbf8-16b2619f1b0c service nova] Creating event network-changed:85ee21b6-2ddd-43b1-b8f4-2677b088a5b8 for instance 73763b31-8f9b-4de3-869a-0e9dc418231f on hv-cinder-80304 Jul 30 16:14:09.599157 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-7f425602-1517-4091-9b5a-43fb1c66ccbf req-fd763c20-0a62-418d-bbf8-16b2619f1b0c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040823 Jul 30 16:14:09.599806 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 529/1068] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:14:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:14:10.406752 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-06b3249d-4154-4382-8882-aa0661bba296 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:10.407382 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-06b3249d-4154-4382-8882-aa0661bba296 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:10.413648 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-06b3249d-4154-4382-8882-aa0661bba296 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:10.414097 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-06b3249d-4154-4382-8882-aa0661bba296 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:10.414865 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-06b3249d-4154-4382-8882-aa0661bba296 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:10.415338 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-06b3249d-4154-4382-8882-aa0661bba296 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:10.545120 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-06b3249d-4154-4382-8882-aa0661bba296 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:10.552399 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-06b3249d-4154-4382-8882-aa0661bba296 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f" status: 200 len: 1362 microversion: 2.1 time: 0.149857 Jul 30 16:14:10.553305 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 540/1069] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:10 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:11.570237 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a0002fb4-864b-492b-a41b-410017159af5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:11.570839 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a0002fb4-864b-492b-a41b-410017159af5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:11.577265 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a0002fb4-864b-492b-a41b-410017159af5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:11.577726 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a0002fb4-864b-492b-a41b-410017159af5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:11.578485 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a0002fb4-864b-492b-a41b-410017159af5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:11.578918 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a0002fb4-864b-492b-a41b-410017159af5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:11.701916 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-a0002fb4-864b-492b-a41b-410017159af5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:11.709133 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a0002fb4-864b-492b-a41b-410017159af5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f" status: 200 len: 1362 microversion: 2.1 time: 0.143368 Jul 30 16:14:11.709699 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 530/1070] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:11 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:12.729245 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0801ea07-6c9d-4759-81ca-7bd67c630807 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:12.729245 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0801ea07-6c9d-4759-81ca-7bd67c630807 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:12.734886 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0801ea07-6c9d-4759-81ca-7bd67c630807 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:12.735383 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0801ea07-6c9d-4759-81ca-7bd67c630807 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:12.736178 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0801ea07-6c9d-4759-81ca-7bd67c630807 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:12.736616 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0801ea07-6c9d-4759-81ca-7bd67c630807 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:12.860001 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0801ea07-6c9d-4759-81ca-7bd67c630807 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:12.867337 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0801ea07-6c9d-4759-81ca-7bd67c630807 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f" status: 200 len: 1362 microversion: 2.1 time: 0.144111 Jul 30 16:14:12.867928 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 541/1071] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:12 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:13.398144 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c6e9c6cc-04bc-4678-b13a-fe3200a806cc tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:13.398691 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c6e9c6cc-04bc-4678-b13a-fe3200a806cc tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:13.405673 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c6e9c6cc-04bc-4678-b13a-fe3200a806cc tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:13.406123 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c6e9c6cc-04bc-4678-b13a-fe3200a806cc tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:13.406910 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c6e9c6cc-04bc-4678-b13a-fe3200a806cc tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:13.407374 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c6e9c6cc-04bc-4678-b13a-fe3200a806cc tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:13.429956 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.objects.instance [None req-c6e9c6cc-04bc-4678-b13a-fe3200a806cc tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lazy-loading 'flavor' on Instance uuid cde02f58-42c0-417a-94c5-7b65163fb5f2 {{(pid=107452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:14:13.690960 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c6e9c6cc-04bc-4678-b13a-fe3200a806cc tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 202 len: 0 microversion: 2.20 time: 0.296242 Jul 30 16:14:13.692471 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 531/1072] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:14:13 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 16:14:13.700882 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-df9ef3ae-b80f-41a3-abe6-a1ded922ce78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:13.701496 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-df9ef3ae-b80f-41a3-abe6-a1ded922ce78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:13.707513 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-df9ef3ae-b80f-41a3-abe6-a1ded922ce78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:13.707959 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-df9ef3ae-b80f-41a3-abe6-a1ded922ce78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:13.708798 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-df9ef3ae-b80f-41a3-abe6-a1ded922ce78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:13.709390 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-df9ef3ae-b80f-41a3-abe6-a1ded922ce78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:13.836414 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-df9ef3ae-b80f-41a3-abe6-a1ded922ce78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:13.845291 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-df9ef3ae-b80f-41a3-abe6-a1ded922ce78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:13.847196 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-df9ef3ae-b80f-41a3-abe6-a1ded922ce78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:13.848367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-df9ef3ae-b80f-41a3-abe6-a1ded922ce78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1722 microversion: 2.20 time: 0.152193 Jul 30 16:14:13.848954 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 542/1073] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:13 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:13.884448 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b9e38304-16a7-4572-a6de-64dc5e200431 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:13.885176 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b9e38304-16a7-4572-a6de-64dc5e200431 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:13.892934 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b9e38304-16a7-4572-a6de-64dc5e200431 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:13.893412 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b9e38304-16a7-4572-a6de-64dc5e200431 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:13.894218 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b9e38304-16a7-4572-a6de-64dc5e200431 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:13.894631 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b9e38304-16a7-4572-a6de-64dc5e200431 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:14.021677 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b9e38304-16a7-4572-a6de-64dc5e200431 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:14.030577 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b9e38304-16a7-4572-a6de-64dc5e200431 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f" status: 200 len: 1362 microversion: 2.1 time: 0.150218 Jul 30 16:14:14.031513 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 532/1074] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:13 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:14.868837 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b95f60e2-cad5-4909-b7ad-b98ddb62daad tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:14.869438 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b95f60e2-cad5-4909-b7ad-b98ddb62daad tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:14.876883 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b95f60e2-cad5-4909-b7ad-b98ddb62daad tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:14.878489 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b95f60e2-cad5-4909-b7ad-b98ddb62daad tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:14.879355 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b95f60e2-cad5-4909-b7ad-b98ddb62daad tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:14.879791 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b95f60e2-cad5-4909-b7ad-b98ddb62daad tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:15.003873 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b95f60e2-cad5-4909-b7ad-b98ddb62daad tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:15.012538 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b95f60e2-cad5-4909-b7ad-b98ddb62daad tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:15.014051 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b95f60e2-cad5-4909-b7ad-b98ddb62daad tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:15.015229 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b95f60e2-cad5-4909-b7ad-b98ddb62daad tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1722 microversion: 2.20 time: 0.150107 Jul 30 16:14:15.015786 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 543/1075] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:14 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:15.047690 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3d989379-9a6c-459b-b144-9f2b2f82971e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:15.048404 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3d989379-9a6c-459b-b144-9f2b2f82971e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:15.055501 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3d989379-9a6c-459b-b144-9f2b2f82971e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:15.056255 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3d989379-9a6c-459b-b144-9f2b2f82971e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:15.057244 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3d989379-9a6c-459b-b144-9f2b2f82971e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:15.059189 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3d989379-9a6c-459b-b144-9f2b2f82971e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:15.191055 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-3d989379-9a6c-459b-b144-9f2b2f82971e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:15.198207 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3d989379-9a6c-459b-b144-9f2b2f82971e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f" status: 200 len: 1362 microversion: 2.1 time: 0.154371 Jul 30 16:14:15.198767 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 533/1076] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:15 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:16.033909 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0e734927-f73c-40ff-9288-9bcdc5c68ff3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:16.034544 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0e734927-f73c-40ff-9288-9bcdc5c68ff3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:16.040403 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0e734927-f73c-40ff-9288-9bcdc5c68ff3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:16.040856 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0e734927-f73c-40ff-9288-9bcdc5c68ff3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:16.041618 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0e734927-f73c-40ff-9288-9bcdc5c68ff3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:16.042051 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0e734927-f73c-40ff-9288-9bcdc5c68ff3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:16.165223 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0e734927-f73c-40ff-9288-9bcdc5c68ff3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:16.174031 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0e734927-f73c-40ff-9288-9bcdc5c68ff3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:16.175498 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0e734927-f73c-40ff-9288-9bcdc5c68ff3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:16.176852 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0e734927-f73c-40ff-9288-9bcdc5c68ff3 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1722 microversion: 2.20 time: 0.146567 Jul 30 16:14:16.177202 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 544/1077] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:16 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:16.215576 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-73344d63-3788-4832-85d0-598b333daa01 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:16.216424 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-73344d63-3788-4832-85d0-598b333daa01 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:16.223455 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-73344d63-3788-4832-85d0-598b333daa01 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:16.223905 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-73344d63-3788-4832-85d0-598b333daa01 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:16.224684 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-73344d63-3788-4832-85d0-598b333daa01 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:16.225121 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-73344d63-3788-4832-85d0-598b333daa01 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:16.347410 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-73344d63-3788-4832-85d0-598b333daa01 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:16.354577 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-73344d63-3788-4832-85d0-598b333daa01 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f" status: 200 len: 1362 microversion: 2.1 time: 0.142932 Jul 30 16:14:16.355158 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 534/1078] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:16 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:17.196424 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1ddc20e6-96ae-47a4-a80b-71fb51822704 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:17.197916 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1ddc20e6-96ae-47a4-a80b-71fb51822704 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:17.207468 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1ddc20e6-96ae-47a4-a80b-71fb51822704 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:17.208285 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1ddc20e6-96ae-47a4-a80b-71fb51822704 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:17.209924 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1ddc20e6-96ae-47a4-a80b-71fb51822704 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:17.210818 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1ddc20e6-96ae-47a4-a80b-71fb51822704 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:17.248138 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-6b37634d-c78e-4333-8c80-8b688228a6ba req-905c9e6d-ea0e-4fe2-907e-02570f3f9227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73763b31-8f9b-4de3-869a-0e9dc418231f", "name": "network-vif-plugged", "status": "completed", "tag": "85ee21b6-2ddd-43b1-b8f4-2677b088a5b8"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:17.249712 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:14:17.249712 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:14:17.260512 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-6b37634d-c78e-4333-8c80-8b688228a6ba req-905c9e6d-ea0e-4fe2-907e-02570f3f9227 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:17.261231 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-6b37634d-c78e-4333-8c80-8b688228a6ba req-905c9e6d-ea0e-4fe2-907e-02570f3f9227 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:17.275174 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-6b37634d-c78e-4333-8c80-8b688228a6ba req-905c9e6d-ea0e-4fe2-907e-02570f3f9227 service nova] Creating event network-vif-plugged:85ee21b6-2ddd-43b1-b8f4-2677b088a5b8 for instance 73763b31-8f9b-4de3-869a-0e9dc418231f on hv-cinder-80304 Jul 30 16:14:17.280888 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-6b37634d-c78e-4333-8c80-8b688228a6ba req-905c9e6d-ea0e-4fe2-907e-02570f3f9227 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037120 Jul 30 16:14:17.282263 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 535/1079] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:14:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:14:17.378277 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d8b2f3f9-33ac-4aef-acab-aa3642c61f1b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:17.379356 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d8b2f3f9-33ac-4aef-acab-aa3642c61f1b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:17.385179 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1ddc20e6-96ae-47a4-a80b-71fb51822704 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:17.393169 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d8b2f3f9-33ac-4aef-acab-aa3642c61f1b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:17.394014 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d8b2f3f9-33ac-4aef-acab-aa3642c61f1b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:17.394971 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d8b2f3f9-33ac-4aef-acab-aa3642c61f1b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:17.395871 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d8b2f3f9-33ac-4aef-acab-aa3642c61f1b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:17.405869 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1ddc20e6-96ae-47a4-a80b-71fb51822704 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:17.407785 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1ddc20e6-96ae-47a4-a80b-71fb51822704 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:17.409906 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1ddc20e6-96ae-47a4-a80b-71fb51822704 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1722 microversion: 2.20 time: 0.217827 Jul 30 16:14:17.410918 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 545/1080] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:17 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:14:17.546863 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d8b2f3f9-33ac-4aef-acab-aa3642c61f1b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:17.554240 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d8b2f3f9-33ac-4aef-acab-aa3642c61f1b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f" status: 200 len: 1362 microversion: 2.1 time: 0.184968 Jul 30 16:14:17.554889 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 536/1081] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:17 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:14:18.429450 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0fffea36-2784-4083-9a9b-051e908344e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:18.430736 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0fffea36-2784-4083-9a9b-051e908344e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:18.438536 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0fffea36-2784-4083-9a9b-051e908344e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:18.439459 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0fffea36-2784-4083-9a9b-051e908344e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:18.440329 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0fffea36-2784-4083-9a9b-051e908344e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:18.440853 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0fffea36-2784-4083-9a9b-051e908344e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:18.571620 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-5b469f10-f3dc-4fbc-974b-6a1f2cbb43f4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:18.573863 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-5b469f10-f3dc-4fbc-974b-6a1f2cbb43f4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:18.583800 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5b469f10-f3dc-4fbc-974b-6a1f2cbb43f4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:18.584453 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5b469f10-f3dc-4fbc-974b-6a1f2cbb43f4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:18.585405 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5b469f10-f3dc-4fbc-974b-6a1f2cbb43f4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:18.585834 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-5b469f10-f3dc-4fbc-974b-6a1f2cbb43f4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:18.602908 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0fffea36-2784-4083-9a9b-051e908344e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:18.614674 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0fffea36-2784-4083-9a9b-051e908344e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:18.616667 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0fffea36-2784-4083-9a9b-051e908344e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:18.618299 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0fffea36-2784-4083-9a9b-051e908344e1 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1722 microversion: 2.20 time: 0.193016 Jul 30 16:14:18.619105 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 546/1082] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:18 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:14:18.813372 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-5b469f10-f3dc-4fbc-974b-6a1f2cbb43f4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:18.822206 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-5b469f10-f3dc-4fbc-974b-6a1f2cbb43f4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f" status: 200 len: 1548 microversion: 2.1 time: 0.254259 Jul 30 16:14:18.822952 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 537/1083] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:18 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f => generated 1548 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:18.838177 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-cb3036e5-64fa-44be-81f9-977e38cf64b3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:18.838671 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-cb3036e5-64fa-44be-81f9-977e38cf64b3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:18.848856 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cb3036e5-64fa-44be-81f9-977e38cf64b3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:18.849313 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cb3036e5-64fa-44be-81f9-977e38cf64b3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:18.852565 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cb3036e5-64fa-44be-81f9-977e38cf64b3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:18.853019 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cb3036e5-64fa-44be-81f9-977e38cf64b3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:18.941078 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-cb3036e5-64fa-44be-81f9-977e38cf64b3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106516 Jul 30 16:14:18.942055 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 547/1084] 10.222.0.37 () {58 vars in 1275 bytes} [Fri Jul 30 16:14:18 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:14:19.638171 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-823f17a1-73ad-4577-80f6-09aa7ea9dec9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:19.640129 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-823f17a1-73ad-4577-80f6-09aa7ea9dec9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:19.646943 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-823f17a1-73ad-4577-80f6-09aa7ea9dec9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:19.647682 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-823f17a1-73ad-4577-80f6-09aa7ea9dec9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:19.648671 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-823f17a1-73ad-4577-80f6-09aa7ea9dec9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:19.649264 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-823f17a1-73ad-4577-80f6-09aa7ea9dec9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:19.894027 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-823f17a1-73ad-4577-80f6-09aa7ea9dec9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:19.908595 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-823f17a1-73ad-4577-80f6-09aa7ea9dec9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:19.910706 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-823f17a1-73ad-4577-80f6-09aa7ea9dec9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:19.912116 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-823f17a1-73ad-4577-80f6-09aa7ea9dec9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1722 microversion: 2.20 time: 0.278428 Jul 30 16:14:19.913194 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 538/1085] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:19 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:20.284176 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-399da040-aa41-4964-9e49-6bc729bcc826 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:20.285155 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-399da040-aa41-4964-9e49-6bc729bcc826 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:20.289084 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-cc04a500-6d85-4653-823a-709ebb65b3e7 req-41592538-f519-41ad-9616-04d262dade37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73763b31-8f9b-4de3-869a-0e9dc418231f", "tag": "85ee21b6-2ddd-43b1-b8f4-2677b088a5b8"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:20.290787 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:14:20.290787 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:14:20.296872 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-399da040-aa41-4964-9e49-6bc729bcc826 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:20.297081 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-399da040-aa41-4964-9e49-6bc729bcc826 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:20.298752 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-399da040-aa41-4964-9e49-6bc729bcc826 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:20.299221 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-399da040-aa41-4964-9e49-6bc729bcc826 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:20.305550 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-cc04a500-6d85-4653-823a-709ebb65b3e7 req-41592538-f519-41ad-9616-04d262dade37 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:20.305998 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-cc04a500-6d85-4653-823a-709ebb65b3e7 req-41592538-f519-41ad-9616-04d262dade37 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:20.334425 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-cc04a500-6d85-4653-823a-709ebb65b3e7 req-41592538-f519-41ad-9616-04d262dade37 service nova] Creating event network-changed:85ee21b6-2ddd-43b1-b8f4-2677b088a5b8 for instance 73763b31-8f9b-4de3-869a-0e9dc418231f on hv-cinder-80304 Jul 30 16:14:20.343207 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-cc04a500-6d85-4653-823a-709ebb65b3e7 req-41592538-f519-41ad-9616-04d262dade37 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057761 Jul 30 16:14:20.344925 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 539/1086] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:14:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:14:20.368432 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-399da040-aa41-4964-9e49-6bc729bcc826 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 14 microversion: 2.1 time: 0.087771 Jul 30 16:14:20.372377 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 548/1087] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:20 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:14:20.929985 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-382c2d27-df77-4dcc-bb06-11efa7531859 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:20.930687 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-382c2d27-df77-4dcc-bb06-11efa7531859 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:20.938348 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-382c2d27-df77-4dcc-bb06-11efa7531859 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:20.940243 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-382c2d27-df77-4dcc-bb06-11efa7531859 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:20.941992 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-382c2d27-df77-4dcc-bb06-11efa7531859 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:20.943262 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-382c2d27-df77-4dcc-bb06-11efa7531859 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:21.381288 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8132a6b5-4d30-4332-84db-6a7840ecd204 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:21.382289 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-8132a6b5-4d30-4332-84db-6a7840ecd204 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:21.391004 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8132a6b5-4d30-4332-84db-6a7840ecd204 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:21.391747 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8132a6b5-4d30-4332-84db-6a7840ecd204 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:21.392519 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8132a6b5-4d30-4332-84db-6a7840ecd204 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:21.392943 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8132a6b5-4d30-4332-84db-6a7840ecd204 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:21.435192 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-382c2d27-df77-4dcc-bb06-11efa7531859 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:21.446102 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-382c2d27-df77-4dcc-bb06-11efa7531859 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:21.453382 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-382c2d27-df77-4dcc-bb06-11efa7531859 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:21.457181 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-382c2d27-df77-4dcc-bb06-11efa7531859 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1722 microversion: 2.20 time: 0.530971 Jul 30 16:14:21.459213 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 540/1088] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:20 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1722 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:21.471519 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8132a6b5-4d30-4332-84db-6a7840ecd204 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 14 microversion: 2.1 time: 0.094859 Jul 30 16:14:21.472158 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 549/1089] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:21 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 30 16:14:22.478383 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b197b9bc-9129-4284-9670-08240b8499b2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:22.482575 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b197b9bc-9129-4284-9670-08240b8499b2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:22.492830 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b197b9bc-9129-4284-9670-08240b8499b2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:22.496682 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b197b9bc-9129-4284-9670-08240b8499b2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:22.497918 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b197b9bc-9129-4284-9670-08240b8499b2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:22.499093 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b197b9bc-9129-4284-9670-08240b8499b2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:22.504024 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-fe288780-5b7b-4276-875e-f4208a4b14f5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:22.505902 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-fe288780-5b7b-4276-875e-f4208a4b14f5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:22.515217 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fe288780-5b7b-4276-875e-f4208a4b14f5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:22.515674 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fe288780-5b7b-4276-875e-f4208a4b14f5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:22.516496 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fe288780-5b7b-4276-875e-f4208a4b14f5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:22.516929 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fe288780-5b7b-4276-875e-f4208a4b14f5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:22.605885 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-fe288780-5b7b-4276-875e-f4208a4b14f5 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 14 microversion: 2.1 time: 0.113464 Jul 30 16:14:22.606540 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 550/1090] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:22 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:14:22.752557 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b197b9bc-9129-4284-9670-08240b8499b2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:22.763783 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b197b9bc-9129-4284-9670-08240b8499b2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:22.766407 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-b197b9bc-9129-4284-9670-08240b8499b2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:22.768144 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b197b9bc-9129-4284-9670-08240b8499b2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1722 microversion: 2.20 time: 0.295764 Jul 30 16:14:22.769282 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 541/1091] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:22 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1722 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:22.851045 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-91f4ec0e-491f-4936-87ed-6784b8bb8294 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1934881414", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2065592267", "security_groups": [{"name": "tempest-secgroup-smoke-1585456609"}], "block_device_mapping_v2": [{"uuid": "b15b3cdf-9a21-410e-b9fa-4437822d44b5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7d0da8fd-0a56-4002-b0c2-d66355f139a4"}]}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:22.967490 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.network.neutron [None req-91f4ec0e-491f-4936-87ed-6784b8bb8294 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] validate_networks() for [('7d0da8fd-0a56-4002-b0c2-d66355f139a4', None, None, None)] {{(pid=107453) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:14:23.431973 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-91f4ec0e-491f-4936-87ed-6784b8bb8294 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Flavor limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:14:23.432745 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-91f4ec0e-491f-4936-87ed-6784b8bb8294 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Image limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:14:23.433259 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-91f4ec0e-491f-4936-87ed-6784b8bb8294 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Flavor pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:14:23.434265 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-91f4ec0e-491f-4936-87ed-6784b8bb8294 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Image pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:14:23.434804 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-91f4ec0e-491f-4936-87ed-6784b8bb8294 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:14:23.446835 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-91f4ec0e-491f-4936-87ed-6784b8bb8294 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:23.447457 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-91f4ec0e-491f-4936-87ed-6784b8bb8294 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:23.448943 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-91f4ec0e-491f-4936-87ed-6784b8bb8294 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:23.450126 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-91f4ec0e-491f-4936-87ed-6784b8bb8294 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:23.472047 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-91f4ec0e-491f-4936-87ed-6784b8bb8294 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Getting quotas for project 07bf3493a71648c895b14d999b3bfb1e. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:14:23.476486 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-91f4ec0e-491f-4936-87ed-6784b8bb8294 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Getting quotas for user ea3885b43f9a4d32aab4abebece046c8 and project 07bf3493a71648c895b14d999b3bfb1e. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:14:23.547010 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-91f4ec0e-491f-4936-87ed-6784b8bb8294 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Going to run 1 instances... {{(pid=107453) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:14:23.549274 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-91f4ec0e-491f-4936-87ed-6784b8bb8294 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b15b3cdf-9a21-410e-b9fa-4437822d44b5',volume_size=None,volume_type=None)] {{(pid=107453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:14:23.620124 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-2605dd2c-4e8a-4abb-bdd1-f3ff1b1c4332 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:23.622515 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-2605dd2c-4e8a-4abb-bdd1-f3ff1b1c4332 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:23.634113 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2605dd2c-4e8a-4abb-bdd1-f3ff1b1c4332 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:23.635177 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2605dd2c-4e8a-4abb-bdd1-f3ff1b1c4332 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:23.636588 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2605dd2c-4e8a-4abb-bdd1-f3ff1b1c4332 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:23.638145 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2605dd2c-4e8a-4abb-bdd1-f3ff1b1c4332 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:23.707782 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-2605dd2c-4e8a-4abb-bdd1-f3ff1b1c4332 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 14 microversion: 2.1 time: 0.094256 Jul 30 16:14:23.708754 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 542/1092] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:23 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:14:23.716420 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-91f4ec0e-491f-4936-87ed-6784b8bb8294 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.869585 Jul 30 16:14:23.717058 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 551/1093] 10.222.0.37 () {60 vars in 1147 bytes} [Fri Jul 30 16:14:22 2021] POST /compute/v2.1/servers => generated 406 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 16:14:23.737205 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-2fb2de15-2c2d-4813-9c2f-12f2eb19cdb3 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:23.738022 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-2fb2de15-2c2d-4813-9c2f-12f2eb19cdb3 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:23.789560 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-524bb642-fc68-4504-80ad-7da041b44646 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:23.790493 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-524bb642-fc68-4504-80ad-7da041b44646 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:23.799728 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-524bb642-fc68-4504-80ad-7da041b44646 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:23.800467 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-524bb642-fc68-4504-80ad-7da041b44646 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:23.801500 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-524bb642-fc68-4504-80ad-7da041b44646 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:23.802199 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-524bb642-fc68-4504-80ad-7da041b44646 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:23.805605 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-2fb2de15-2c2d-4813-9c2f-12f2eb19cdb3 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:23.815583 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-2fb2de15-2c2d-4813-9c2f-12f2eb19cdb3 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 200 len: 1095 microversion: 2.1 time: 0.082319 Jul 30 16:14:23.823579 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 543/1094] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:23 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 1095 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:23.963511 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-524bb642-fc68-4504-80ad-7da041b44646 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:23.974339 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-524bb642-fc68-4504-80ad-7da041b44646 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:23.978341 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-524bb642-fc68-4504-80ad-7da041b44646 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:23.980178 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-524bb642-fc68-4504-80ad-7da041b44646 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1722 microversion: 2.20 time: 0.195710 Jul 30 16:14:23.994901 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 552/1095] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:23 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:24.718505 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1f999649-19a9-4239-8a3d-8398d613f3d0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:24.719722 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1f999649-19a9-4239-8a3d-8398d613f3d0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:24.732269 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f999649-19a9-4239-8a3d-8398d613f3d0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:24.732721 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f999649-19a9-4239-8a3d-8398d613f3d0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:24.733726 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f999649-19a9-4239-8a3d-8398d613f3d0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:24.734332 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f999649-19a9-4239-8a3d-8398d613f3d0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:24.818814 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1f999649-19a9-4239-8a3d-8398d613f3d0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 14 microversion: 2.1 time: 0.104389 Jul 30 16:14:24.820537 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 544/1096] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:24 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:14:24.841340 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-30cfe496-13af-4f1d-8ce6-887ff3bd3b68 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:24.842764 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-30cfe496-13af-4f1d-8ce6-887ff3bd3b68 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:24.853885 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-30cfe496-13af-4f1d-8ce6-887ff3bd3b68 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:24.854681 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-30cfe496-13af-4f1d-8ce6-887ff3bd3b68 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:24.856394 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-30cfe496-13af-4f1d-8ce6-887ff3bd3b68 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:24.857002 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-30cfe496-13af-4f1d-8ce6-887ff3bd3b68 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:24.932068 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-30cfe496-13af-4f1d-8ce6-887ff3bd3b68 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:24.941569 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-30cfe496-13af-4f1d-8ce6-887ff3bd3b68 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 200 len: 1193 microversion: 2.1 time: 0.106601 Jul 30 16:14:24.942727 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 553/1097] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:24 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 1193 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:25.000076 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1cb98e01-55d9-4e1b-a2a4-88b971479e28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:25.000956 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1cb98e01-55d9-4e1b-a2a4-88b971479e28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:25.017425 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1cb98e01-55d9-4e1b-a2a4-88b971479e28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:25.024047 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1cb98e01-55d9-4e1b-a2a4-88b971479e28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:25.026234 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1cb98e01-55d9-4e1b-a2a4-88b971479e28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:25.026874 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1cb98e01-55d9-4e1b-a2a4-88b971479e28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:25.423730 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1cb98e01-55d9-4e1b-a2a4-88b971479e28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:25.432142 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1cb98e01-55d9-4e1b-a2a4-88b971479e28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:25.433694 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1cb98e01-55d9-4e1b-a2a4-88b971479e28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:25.434942 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1cb98e01-55d9-4e1b-a2a4-88b971479e28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1743 microversion: 2.20 time: 0.439877 Jul 30 16:14:25.442907 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 545/1098] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:24 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1743 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:25.839549 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-61385c27-aeb9-486a-b5c8-5d3403c06f0d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:25.854506 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-61385c27-aeb9-486a-b5c8-5d3403c06f0d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:25.912365 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-61385c27-aeb9-486a-b5c8-5d3403c06f0d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:25.912834 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-61385c27-aeb9-486a-b5c8-5d3403c06f0d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:25.921932 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-61385c27-aeb9-486a-b5c8-5d3403c06f0d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:25.927397 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-61385c27-aeb9-486a-b5c8-5d3403c06f0d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:25.959669 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-44bc5a04-307b-4fdc-bdcd-14abc5338e4e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:25.960281 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-44bc5a04-307b-4fdc-bdcd-14abc5338e4e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:25.976587 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-44bc5a04-307b-4fdc-bdcd-14abc5338e4e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:25.977033 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-44bc5a04-307b-4fdc-bdcd-14abc5338e4e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:25.983560 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-44bc5a04-307b-4fdc-bdcd-14abc5338e4e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:25.987286 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-44bc5a04-307b-4fdc-bdcd-14abc5338e4e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:26.125500 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-61385c27-aeb9-486a-b5c8-5d3403c06f0d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 14 microversion: 2.1 time: 0.298377 Jul 30 16:14:26.126382 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 554/1099] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:25 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 14 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:14:26.455695 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-72b5fed7-b46b-4c2c-89e9-e6034f0c4124 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:26.456728 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-72b5fed7-b46b-4c2c-89e9-e6034f0c4124 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:26.477954 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-72b5fed7-b46b-4c2c-89e9-e6034f0c4124 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:26.478397 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-72b5fed7-b46b-4c2c-89e9-e6034f0c4124 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:26.485439 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-72b5fed7-b46b-4c2c-89e9-e6034f0c4124 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:26.489893 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-72b5fed7-b46b-4c2c-89e9-e6034f0c4124 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:26.876131 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-44bc5a04-307b-4fdc-bdcd-14abc5338e4e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:26.890879 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-44bc5a04-307b-4fdc-bdcd-14abc5338e4e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 200 len: 1279 microversion: 2.1 time: 0.929409 Jul 30 16:14:26.892145 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 546/1100] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:25 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 1279 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:27.027278 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-72b5fed7-b46b-4c2c-89e9-e6034f0c4124 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:27.037198 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-72b5fed7-b46b-4c2c-89e9-e6034f0c4124 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:27.041013 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-72b5fed7-b46b-4c2c-89e9-e6034f0c4124 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:27.044647 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-72b5fed7-b46b-4c2c-89e9-e6034f0c4124 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1738 microversion: 2.20 time: 0.593216 Jul 30 16:14:27.046502 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 555/1101] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:26 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1738 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:27.137577 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3216eb7b-5a75-434d-98e6-157a5b232daf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:27.138550 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3216eb7b-5a75-434d-98e6-157a5b232daf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:27.149476 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3216eb7b-5a75-434d-98e6-157a5b232daf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:27.150827 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3216eb7b-5a75-434d-98e6-157a5b232daf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:27.155914 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3216eb7b-5a75-434d-98e6-157a5b232daf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:27.156638 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3216eb7b-5a75-434d-98e6-157a5b232daf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:27.244973 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3216eb7b-5a75-434d-98e6-157a5b232daf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 14 microversion: 2.1 time: 0.112493 Jul 30 16:14:27.247278 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 547/1102] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:27 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:14:27.868316 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-4d1b88fd-3980-479b-a841-83d3656c130a req-6d2f1aae-83fc-4146-9607-e4a19d4fce0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36700cb8-81e3-47e4-96f9-9b417e29aef8", "tag": "1d4d5279-4d0d-4100-9111-bce087569c04"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:27.872063 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:14:27.872063 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:14:27.889905 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-4d1b88fd-3980-479b-a841-83d3656c130a req-6d2f1aae-83fc-4146-9607-e4a19d4fce0a service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:27.890354 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-4d1b88fd-3980-479b-a841-83d3656c130a req-6d2f1aae-83fc-4146-9607-e4a19d4fce0a service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:27.908789 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-06101fef-9487-46dc-b42a-e5edb25fac8e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:27.909389 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-06101fef-9487-46dc-b42a-e5edb25fac8e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:27.936490 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-06101fef-9487-46dc-b42a-e5edb25fac8e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:27.936949 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-06101fef-9487-46dc-b42a-e5edb25fac8e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:27.937751 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-06101fef-9487-46dc-b42a-e5edb25fac8e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:27.938194 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-06101fef-9487-46dc-b42a-e5edb25fac8e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:27.949870 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-4d1b88fd-3980-479b-a841-83d3656c130a req-6d2f1aae-83fc-4146-9607-e4a19d4fce0a service nova] Creating event network-changed:1d4d5279-4d0d-4100-9111-bce087569c04 for instance 36700cb8-81e3-47e4-96f9-9b417e29aef8 on hv-cinder-80304 Jul 30 16:14:27.970376 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-4d1b88fd-3980-479b-a841-83d3656c130a req-6d2f1aae-83fc-4146-9607-e4a19d4fce0a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105809 Jul 30 16:14:27.978665 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 556/1103] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:14:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:14:28.070194 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d560dc5b-7a5c-4eee-966f-7cb138778512 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:28.070907 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d560dc5b-7a5c-4eee-966f-7cb138778512 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:28.093852 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d560dc5b-7a5c-4eee-966f-7cb138778512 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:28.094313 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d560dc5b-7a5c-4eee-966f-7cb138778512 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:28.095123 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d560dc5b-7a5c-4eee-966f-7cb138778512 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:28.095612 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d560dc5b-7a5c-4eee-966f-7cb138778512 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:28.220403 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-06101fef-9487-46dc-b42a-e5edb25fac8e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:28.231763 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-06101fef-9487-46dc-b42a-e5edb25fac8e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 200 len: 1267 microversion: 2.1 time: 0.326982 Jul 30 16:14:28.251622 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 548/1104] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:27 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 1267 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:28.256744 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-4d15692b-72b9-4394-b482-0224cbaa53bf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:28.257907 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-4d15692b-72b9-4394-b482-0224cbaa53bf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:28.274244 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4d15692b-72b9-4394-b482-0224cbaa53bf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:28.274704 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4d15692b-72b9-4394-b482-0224cbaa53bf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:28.275691 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4d15692b-72b9-4394-b482-0224cbaa53bf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:28.276252 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4d15692b-72b9-4394-b482-0224cbaa53bf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:28.389215 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-4d15692b-72b9-4394-b482-0224cbaa53bf tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 14 microversion: 2.1 time: 0.135926 Jul 30 16:14:28.392452 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 549/1105] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:28 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:14:28.527204 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d560dc5b-7a5c-4eee-966f-7cb138778512 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:28.538764 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d560dc5b-7a5c-4eee-966f-7cb138778512 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:28.547295 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d560dc5b-7a5c-4eee-966f-7cb138778512 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:28.550967 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d560dc5b-7a5c-4eee-966f-7cb138778512 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1738 microversion: 2.20 time: 0.489172 Jul 30 16:14:28.563604 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 557/1106] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:28 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1738 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:14:28.594483 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-2b5a285c-8f3d-48c7-86c8-7e1bb51410ae req-d9529253-4baf-414c-bbd2-8cbda48ae9ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde02f58-42c0-417a-94c5-7b65163fb5f2", "name": "network-vif-plugged", "status": "completed", "tag": "4308e410-9d50-4a55-b027-a6d836a99289"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:28.597618 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:14:28.597618 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:14:28.610323 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-2b5a285c-8f3d-48c7-86c8-7e1bb51410ae req-d9529253-4baf-414c-bbd2-8cbda48ae9ea service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:28.611423 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-2b5a285c-8f3d-48c7-86c8-7e1bb51410ae req-d9529253-4baf-414c-bbd2-8cbda48ae9ea service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:28.626705 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-2b5a285c-8f3d-48c7-86c8-7e1bb51410ae req-d9529253-4baf-414c-bbd2-8cbda48ae9ea service nova] Creating event network-vif-plugged:4308e410-9d50-4a55-b027-a6d836a99289 for instance cde02f58-42c0-417a-94c5-7b65163fb5f2 on hv-cinder-80304 Jul 30 16:14:28.636935 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-2b5a285c-8f3d-48c7-86c8-7e1bb51410ae req-d9529253-4baf-414c-bbd2-8cbda48ae9ea service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048060 Jul 30 16:14:28.638818 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 550/1107] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:14:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:14:29.250362 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-5dc82f0d-cff0-4bf2-8559-760fa33541f4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:29.251044 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-5dc82f0d-cff0-4bf2-8559-760fa33541f4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:29.264746 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5dc82f0d-cff0-4bf2-8559-760fa33541f4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:29.265546 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5dc82f0d-cff0-4bf2-8559-760fa33541f4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:29.266709 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5dc82f0d-cff0-4bf2-8559-760fa33541f4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:29.267381 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5dc82f0d-cff0-4bf2-8559-760fa33541f4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:29.410229 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-cfac8d99-ccd6-4c15-94cd-b0839e9a0ffa tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:29.412090 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-cfac8d99-ccd6-4c15-94cd-b0839e9a0ffa tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:29.420942 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cfac8d99-ccd6-4c15-94cd-b0839e9a0ffa tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:29.425732 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cfac8d99-ccd6-4c15-94cd-b0839e9a0ffa tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:29.426765 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cfac8d99-ccd6-4c15-94cd-b0839e9a0ffa tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:29.427388 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cfac8d99-ccd6-4c15-94cd-b0839e9a0ffa tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:29.535254 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-cfac8d99-ccd6-4c15-94cd-b0839e9a0ffa tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 14 microversion: 2.1 time: 0.136276 Jul 30 16:14:29.537790 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 551/1108] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:29 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:14:29.571599 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ad871dba-c66a-4b28-bfa7-49c9cdf4b80b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:29.573452 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ad871dba-c66a-4b28-bfa7-49c9cdf4b80b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:29.589479 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ad871dba-c66a-4b28-bfa7-49c9cdf4b80b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:29.594638 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ad871dba-c66a-4b28-bfa7-49c9cdf4b80b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:29.600171 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ad871dba-c66a-4b28-bfa7-49c9cdf4b80b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:29.601366 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ad871dba-c66a-4b28-bfa7-49c9cdf4b80b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:29.620615 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-5dc82f0d-cff0-4bf2-8559-760fa33541f4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:29.642809 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-5dc82f0d-cff0-4bf2-8559-760fa33541f4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 200 len: 1267 microversion: 2.1 time: 0.397533 Jul 30 16:14:29.648011 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 558/1109] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:29 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 1267 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:29.899100 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-ad871dba-c66a-4b28-bfa7-49c9cdf4b80b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:29.909261 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-ad871dba-c66a-4b28-bfa7-49c9cdf4b80b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:29.911039 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-ad871dba-c66a-4b28-bfa7-49c9cdf4b80b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:29.913391 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ad871dba-c66a-4b28-bfa7-49c9cdf4b80b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1738 microversion: 2.20 time: 0.347356 Jul 30 16:14:29.914759 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 552/1110] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:29 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1738 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:30.126931 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d01a991b-7940-4592-b2eb-1c01e146ca66 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Action: 'create', calling method: .version_select at 0x7fb17e928040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1170790236"}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:30.156401 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-d01a991b-7940-4592-b2eb-1c01e146ca66 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Getting quotas for project 3c425ffd8fd041f9b548ee591a2bd843. Resources: {'key_pairs'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:14:30.161791 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-d01a991b-7940-4592-b2eb-1c01e146ca66 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Getting quotas for user 96cd6f5201214bcea8ba2ca2acaaab13 and project 3c425ffd8fd041f9b548ee591a2bd843. Resources: {'key_pairs'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:14:30.446619 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-d01a991b-7940-4592-b2eb-1c01e146ca66 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Getting quotas for project 3c425ffd8fd041f9b548ee591a2bd843. Resources: {'key_pairs'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:14:30.453757 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-d01a991b-7940-4592-b2eb-1c01e146ca66 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Getting quotas for user 96cd6f5201214bcea8ba2ca2acaaab13 and project 3c425ffd8fd041f9b548ee591a2bd843. Resources: {'key_pairs'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:14:30.471195 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d01a991b-7940-4592-b2eb-1c01e146ca66 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.671244 Jul 30 16:14:30.476661 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 559/1111] 10.222.0.37 () {60 vars in 1158 bytes} [Fri Jul 30 16:14:29 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:14:30.549417 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-59f084f9-d982-40ae-9242-eb073690176e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:30.550527 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-59f084f9-d982-40ae-9242-eb073690176e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:30.564996 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59f084f9-d982-40ae-9242-eb073690176e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:30.568189 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59f084f9-d982-40ae-9242-eb073690176e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:30.569136 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59f084f9-d982-40ae-9242-eb073690176e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:30.569686 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-59f084f9-d982-40ae-9242-eb073690176e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:30.664728 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-fc578e98-7ded-485b-a694-0259159a0701 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:30.665346 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-fc578e98-7ded-485b-a694-0259159a0701 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:30.673318 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-59f084f9-d982-40ae-9242-eb073690176e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 14 microversion: 2.1 time: 0.128933 Jul 30 16:14:30.674119 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 553/1112] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:30 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 16:14:30.678024 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fc578e98-7ded-485b-a694-0259159a0701 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:30.678836 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fc578e98-7ded-485b-a694-0259159a0701 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:30.684745 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fc578e98-7ded-485b-a694-0259159a0701 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:30.685760 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fc578e98-7ded-485b-a694-0259159a0701 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:30.870318 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-fc578e98-7ded-485b-a694-0259159a0701 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:30.879260 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-fc578e98-7ded-485b-a694-0259159a0701 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 200 len: 1267 microversion: 2.1 time: 0.218157 Jul 30 16:14:30.889953 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 560/1113] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:30 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:14:30.934534 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f45251ea-448d-4bd5-aeda-941c8212033d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:30.935520 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f45251ea-448d-4bd5-aeda-941c8212033d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:30.949773 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f45251ea-448d-4bd5-aeda-941c8212033d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:30.952528 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f45251ea-448d-4bd5-aeda-941c8212033d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:30.955382 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f45251ea-448d-4bd5-aeda-941c8212033d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:30.956018 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f45251ea-448d-4bd5-aeda-941c8212033d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:31.180389 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f45251ea-448d-4bd5-aeda-941c8212033d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:31.192785 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f45251ea-448d-4bd5-aeda-941c8212033d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:31.198219 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f45251ea-448d-4bd5-aeda-941c8212033d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:31.200902 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f45251ea-448d-4bd5-aeda-941c8212033d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1738 microversion: 2.20 time: 0.271460 Jul 30 16:14:31.202123 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 554/1114] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:30 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1738 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:31.689274 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-cf9fa643-d575-4290-9947-46edf7a28d73 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:31.690939 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-cf9fa643-d575-4290-9947-46edf7a28d73 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:31.697810 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cf9fa643-d575-4290-9947-46edf7a28d73 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:31.698358 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cf9fa643-d575-4290-9947-46edf7a28d73 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:31.700372 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cf9fa643-d575-4290-9947-46edf7a28d73 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:31.701316 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-cf9fa643-d575-4290-9947-46edf7a28d73 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:31.814636 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-cf9fa643-d575-4290-9947-46edf7a28d73 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 2275 microversion: 2.1 time: 0.131804 Jul 30 16:14:31.816963 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 561/1115] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:31 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 2275 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:31.897827 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-98c229e4-0618-4516-8e8c-15268f3b33fb tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:31.898571 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-98c229e4-0618-4516-8e8c-15268f3b33fb tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:31.913438 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-98c229e4-0618-4516-8e8c-15268f3b33fb tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:31.914261 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-98c229e4-0618-4516-8e8c-15268f3b33fb tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:31.915233 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-98c229e4-0618-4516-8e8c-15268f3b33fb tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:31.915760 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-98c229e4-0618-4516-8e8c-15268f3b33fb tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:32.099501 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-98c229e4-0618-4516-8e8c-15268f3b33fb tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:32.108696 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-98c229e4-0618-4516-8e8c-15268f3b33fb tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 200 len: 1267 microversion: 2.1 time: 0.215243 Jul 30 16:14:32.115574 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 555/1116] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:31 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:32.232943 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-20089777-e789-4cc5-9a11-3eae78128547 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:32.234022 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-20089777-e789-4cc5-9a11-3eae78128547 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:32.252864 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-20089777-e789-4cc5-9a11-3eae78128547 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:32.253574 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-20089777-e789-4cc5-9a11-3eae78128547 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:32.254747 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-20089777-e789-4cc5-9a11-3eae78128547 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:32.255675 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-20089777-e789-4cc5-9a11-3eae78128547 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:32.432458 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-20089777-e789-4cc5-9a11-3eae78128547 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:32.443494 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-20089777-e789-4cc5-9a11-3eae78128547 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:32.445890 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-20089777-e789-4cc5-9a11-3eae78128547 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:32.447967 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-20089777-e789-4cc5-9a11-3eae78128547 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1738 microversion: 2.20 time: 0.223252 Jul 30 16:14:32.449099 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 562/1117] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:32 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:32.829618 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-47454ecc-5b14-45ce-b48b-6d7cd36c23c0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:32.830871 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-47454ecc-5b14-45ce-b48b-6d7cd36c23c0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:32.838008 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-47454ecc-5b14-45ce-b48b-6d7cd36c23c0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:32.838300 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-47454ecc-5b14-45ce-b48b-6d7cd36c23c0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:32.840454 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-47454ecc-5b14-45ce-b48b-6d7cd36c23c0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:32.841125 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-47454ecc-5b14-45ce-b48b-6d7cd36c23c0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:32.915824 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-47454ecc-5b14-45ce-b48b-6d7cd36c23c0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 12331 microversion: 2.1 time: 0.092365 Jul 30 16:14:32.918776 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 556/1118] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:32 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 12331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:14:33.129302 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-651f8e7f-18c6-4f25-9c95-b969d9b41066 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:33.129914 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-651f8e7f-18c6-4f25-9c95-b969d9b41066 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:33.138536 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-651f8e7f-18c6-4f25-9c95-b969d9b41066 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:33.139349 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-651f8e7f-18c6-4f25-9c95-b969d9b41066 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:33.140370 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-651f8e7f-18c6-4f25-9c95-b969d9b41066 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:33.140997 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-651f8e7f-18c6-4f25-9c95-b969d9b41066 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:33.301961 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-651f8e7f-18c6-4f25-9c95-b969d9b41066 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:33.312184 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-651f8e7f-18c6-4f25-9c95-b969d9b41066 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 200 len: 1267 microversion: 2.1 time: 0.186470 Jul 30 16:14:33.312755 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 563/1119] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:33 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:33.469558 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1ca11a8b-66e8-4c47-a2e4-e5b9d7cb6990 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:33.470994 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1ca11a8b-66e8-4c47-a2e4-e5b9d7cb6990 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:33.479243 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1ca11a8b-66e8-4c47-a2e4-e5b9d7cb6990 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:33.480017 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1ca11a8b-66e8-4c47-a2e4-e5b9d7cb6990 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:33.482105 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1ca11a8b-66e8-4c47-a2e4-e5b9d7cb6990 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:33.482799 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1ca11a8b-66e8-4c47-a2e4-e5b9d7cb6990 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:33.637922 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1ca11a8b-66e8-4c47-a2e4-e5b9d7cb6990 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:33.649713 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1ca11a8b-66e8-4c47-a2e4-e5b9d7cb6990 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:33.651263 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1ca11a8b-66e8-4c47-a2e4-e5b9d7cb6990 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:33.653005 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1ca11a8b-66e8-4c47-a2e4-e5b9d7cb6990 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1738 microversion: 2.20 time: 0.187107 Jul 30 16:14:33.656506 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 557/1120] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:33 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:14:33.933593 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-114251f8-ab4e-4125-9452-c7db7b1ef1da tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:33.935441 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-114251f8-ab4e-4125-9452-c7db7b1ef1da tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:33.943733 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-114251f8-ab4e-4125-9452-c7db7b1ef1da tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:33.944552 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-114251f8-ab4e-4125-9452-c7db7b1ef1da tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:33.946154 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-114251f8-ab4e-4125-9452-c7db7b1ef1da tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:33.947276 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-114251f8-ab4e-4125-9452-c7db7b1ef1da tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:34.039201 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-114251f8-ab4e-4125-9452-c7db7b1ef1da tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 17172 microversion: 2.1 time: 0.110012 Jul 30 16:14:34.043529 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 564/1121] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:33 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 17172 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:14:34.329920 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-83f96184-7285-4042-b365-4461408143c1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:34.330624 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-83f96184-7285-4042-b365-4461408143c1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:34.337533 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-83f96184-7285-4042-b365-4461408143c1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:34.337991 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-83f96184-7285-4042-b365-4461408143c1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:34.338987 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-83f96184-7285-4042-b365-4461408143c1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:34.339471 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-83f96184-7285-4042-b365-4461408143c1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:34.504647 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-83f96184-7285-4042-b365-4461408143c1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:34.512386 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-83f96184-7285-4042-b365-4461408143c1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 200 len: 1267 microversion: 2.1 time: 0.186333 Jul 30 16:14:34.522233 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 558/1122] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:34 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:34.672848 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-693df3e4-9b50-4875-8f92-0983bab29a28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:34.676397 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-693df3e4-9b50-4875-8f92-0983bab29a28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:34.683896 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-693df3e4-9b50-4875-8f92-0983bab29a28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:34.684587 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-693df3e4-9b50-4875-8f92-0983bab29a28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:34.685538 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-693df3e4-9b50-4875-8f92-0983bab29a28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:34.686270 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-693df3e4-9b50-4875-8f92-0983bab29a28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:34.862211 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-693df3e4-9b50-4875-8f92-0983bab29a28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:34.871633 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-693df3e4-9b50-4875-8f92-0983bab29a28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:34.873172 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-693df3e4-9b50-4875-8f92-0983bab29a28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:34.874387 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-693df3e4-9b50-4875-8f92-0983bab29a28 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1738 microversion: 2.20 time: 0.206838 Jul 30 16:14:34.886352 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 565/1123] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:34 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:35.050078 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-30c0c624-7f8e-4730-9cae-84a55bc57255 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:35.051000 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-30c0c624-7f8e-4730-9cae-84a55bc57255 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:35.057213 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-30c0c624-7f8e-4730-9cae-84a55bc57255 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:35.057573 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-30c0c624-7f8e-4730-9cae-84a55bc57255 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:35.059524 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-30c0c624-7f8e-4730-9cae-84a55bc57255 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:35.060203 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-30c0c624-7f8e-4730-9cae-84a55bc57255 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:35.184697 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-30c0c624-7f8e-4730-9cae-84a55bc57255 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 17960 microversion: 2.1 time: 0.137501 Jul 30 16:14:35.186190 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 559/1124] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:35 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 17960 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:14:35.533510 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f5cbf5ff-a4f2-4ddc-813d-2045a4cfa2d2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:35.534448 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f5cbf5ff-a4f2-4ddc-813d-2045a4cfa2d2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:35.550066 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f5cbf5ff-a4f2-4ddc-813d-2045a4cfa2d2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:35.551009 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f5cbf5ff-a4f2-4ddc-813d-2045a4cfa2d2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:35.553196 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f5cbf5ff-a4f2-4ddc-813d-2045a4cfa2d2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:35.554023 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f5cbf5ff-a4f2-4ddc-813d-2045a4cfa2d2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:35.757429 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f5cbf5ff-a4f2-4ddc-813d-2045a4cfa2d2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:35.768912 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f5cbf5ff-a4f2-4ddc-813d-2045a4cfa2d2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 200 len: 1267 microversion: 2.1 time: 0.241699 Jul 30 16:14:35.770199 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 566/1125] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:35 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:35.906234 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-56ad5947-8013-489b-90cd-5de36d4bf9d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:35.906957 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-56ad5947-8013-489b-90cd-5de36d4bf9d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:35.921323 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-56ad5947-8013-489b-90cd-5de36d4bf9d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:35.921773 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-56ad5947-8013-489b-90cd-5de36d4bf9d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:35.922563 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-56ad5947-8013-489b-90cd-5de36d4bf9d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:35.922999 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-56ad5947-8013-489b-90cd-5de36d4bf9d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:36.097865 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-56ad5947-8013-489b-90cd-5de36d4bf9d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:36.109699 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-56ad5947-8013-489b-90cd-5de36d4bf9d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:36.109699 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-56ad5947-8013-489b-90cd-5de36d4bf9d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:36.110096 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-56ad5947-8013-489b-90cd-5de36d4bf9d2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1738 microversion: 2.20 time: 0.220519 Jul 30 16:14:36.110564 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 560/1126] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:35 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:36.197069 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4123186b-e680-4133-8efc-372dc554802d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:36.198087 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4123186b-e680-4133-8efc-372dc554802d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:36.208138 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4123186b-e680-4133-8efc-372dc554802d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:36.208591 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4123186b-e680-4133-8efc-372dc554802d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:36.209392 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4123186b-e680-4133-8efc-372dc554802d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:36.209836 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4123186b-e680-4133-8efc-372dc554802d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:36.298102 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4123186b-e680-4133-8efc-372dc554802d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 19342 microversion: 2.1 time: 0.104872 Jul 30 16:14:36.298981 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 567/1127] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:36 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 19342 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:14:36.786488 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9b88f7af-233a-4b6c-8a65-20ea3507551c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:36.791044 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9b88f7af-233a-4b6c-8a65-20ea3507551c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:36.797509 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9b88f7af-233a-4b6c-8a65-20ea3507551c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:36.797966 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9b88f7af-233a-4b6c-8a65-20ea3507551c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:36.798811 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9b88f7af-233a-4b6c-8a65-20ea3507551c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:36.799273 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9b88f7af-233a-4b6c-8a65-20ea3507551c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:36.970589 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9b88f7af-233a-4b6c-8a65-20ea3507551c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:36.979321 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9b88f7af-233a-4b6c-8a65-20ea3507551c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 200 len: 1267 microversion: 2.1 time: 0.197045 Jul 30 16:14:36.991499 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 561/1128] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:36 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:37.129088 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3a8e3c1e-3547-443d-8823-99b5ffcb3d78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:37.130568 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-3a8e3c1e-3547-443d-8823-99b5ffcb3d78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:37.138285 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3a8e3c1e-3547-443d-8823-99b5ffcb3d78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:37.138880 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3a8e3c1e-3547-443d-8823-99b5ffcb3d78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:37.139832 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3a8e3c1e-3547-443d-8823-99b5ffcb3d78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:37.140334 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3a8e3c1e-3547-443d-8823-99b5ffcb3d78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:37.321885 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3a8e3c1e-3547-443d-8823-99b5ffcb3d78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:37.328173 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3dc7b6c5-b847-4450-840b-8fd41ee09f0e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:37.335843 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3dc7b6c5-b847-4450-840b-8fd41ee09f0e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:37.349189 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3a8e3c1e-3547-443d-8823-99b5ffcb3d78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:37.351973 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3dc7b6c5-b847-4450-840b-8fd41ee09f0e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:37.353759 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3dc7b6c5-b847-4450-840b-8fd41ee09f0e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:37.354970 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3a8e3c1e-3547-443d-8823-99b5ffcb3d78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:37.356993 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3dc7b6c5-b847-4450-840b-8fd41ee09f0e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:37.357946 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3dc7b6c5-b847-4450-840b-8fd41ee09f0e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:37.359429 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-3a8e3c1e-3547-443d-8823-99b5ffcb3d78 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1738 microversion: 2.20 time: 0.234455 Jul 30 16:14:37.375814 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 568/1129] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:37 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:37.443844 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3dc7b6c5-b847-4450-840b-8fd41ee09f0e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 22021 microversion: 2.1 time: 0.136951 Jul 30 16:14:37.444629 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 562/1130] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:37 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 22021 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:14:38.015010 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-68ed914f-480c-41ad-997a-249d3551002b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:38.015749 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-68ed914f-480c-41ad-997a-249d3551002b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:38.025987 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-68ed914f-480c-41ad-997a-249d3551002b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:38.026646 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-68ed914f-480c-41ad-997a-249d3551002b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:38.028528 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-68ed914f-480c-41ad-997a-249d3551002b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:38.029143 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-68ed914f-480c-41ad-997a-249d3551002b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:38.188439 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-68ed914f-480c-41ad-997a-249d3551002b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:38.197091 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-68ed914f-480c-41ad-997a-249d3551002b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 200 len: 1267 microversion: 2.1 time: 0.187690 Jul 30 16:14:38.207764 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 569/1131] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:38 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:38.382831 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-42a295a4-acc5-46c3-97f4-43cc24bb4e34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:38.383579 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-42a295a4-acc5-46c3-97f4-43cc24bb4e34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:38.390753 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-42a295a4-acc5-46c3-97f4-43cc24bb4e34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:38.391446 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-42a295a4-acc5-46c3-97f4-43cc24bb4e34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:38.392414 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-42a295a4-acc5-46c3-97f4-43cc24bb4e34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:38.393018 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-42a295a4-acc5-46c3-97f4-43cc24bb4e34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:38.456753 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b26c750b-2061-46e6-82ae-515421d1c153 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:38.458077 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b26c750b-2061-46e6-82ae-515421d1c153 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:38.464348 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b26c750b-2061-46e6-82ae-515421d1c153 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:38.465680 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b26c750b-2061-46e6-82ae-515421d1c153 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:38.466912 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b26c750b-2061-46e6-82ae-515421d1c153 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:38.468407 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b26c750b-2061-46e6-82ae-515421d1c153 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:38.541936 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-42a295a4-acc5-46c3-97f4-43cc24bb4e34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:38.550872 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b26c750b-2061-46e6-82ae-515421d1c153 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 23225 microversion: 2.1 time: 0.097980 Jul 30 16:14:38.551829 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 570/1132] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:38 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 23225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:14:38.559175 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-42a295a4-acc5-46c3-97f4-43cc24bb4e34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:38.560817 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-42a295a4-acc5-46c3-97f4-43cc24bb4e34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:38.562079 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-42a295a4-acc5-46c3-97f4-43cc24bb4e34 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1738 microversion: 2.20 time: 0.183311 Jul 30 16:14:38.562905 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 563/1133] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:38 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:39.221541 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-960f8627-6218-4a0b-b15c-d2a9cc79c21e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:39.222246 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-960f8627-6218-4a0b-b15c-d2a9cc79c21e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:39.228834 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-960f8627-6218-4a0b-b15c-d2a9cc79c21e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:39.229286 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-960f8627-6218-4a0b-b15c-d2a9cc79c21e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:39.230088 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-960f8627-6218-4a0b-b15c-d2a9cc79c21e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:39.231213 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-960f8627-6218-4a0b-b15c-d2a9cc79c21e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:39.312366 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-e76c5cdd-994e-4006-8a1c-a7a7388d1b16 req-85e90fc1-63f9-4f50-8a2a-34fd608cda13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36700cb8-81e3-47e4-96f9-9b417e29aef8", "name": "network-vif-plugged", "status": "completed", "tag": "1d4d5279-4d0d-4100-9111-bce087569c04"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:39.314317 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:14:39.314317 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:14:39.321376 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-e76c5cdd-994e-4006-8a1c-a7a7388d1b16 req-85e90fc1-63f9-4f50-8a2a-34fd608cda13 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:39.321806 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-e76c5cdd-994e-4006-8a1c-a7a7388d1b16 req-85e90fc1-63f9-4f50-8a2a-34fd608cda13 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:39.333753 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-e76c5cdd-994e-4006-8a1c-a7a7388d1b16 req-85e90fc1-63f9-4f50-8a2a-34fd608cda13 service nova] Creating event network-vif-plugged:1d4d5279-4d0d-4100-9111-bce087569c04 for instance 36700cb8-81e3-47e4-96f9-9b417e29aef8 on hv-cinder-80304 Jul 30 16:14:39.338585 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-e76c5cdd-994e-4006-8a1c-a7a7388d1b16 req-85e90fc1-63f9-4f50-8a2a-34fd608cda13 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030140 Jul 30 16:14:39.339191 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 564/1134] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:14:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:14:39.362356 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-960f8627-6218-4a0b-b15c-d2a9cc79c21e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:39.370006 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-960f8627-6218-4a0b-b15c-d2a9cc79c21e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 200 len: 1267 microversion: 2.1 time: 0.152429 Jul 30 16:14:39.370793 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 571/1135] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:39 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:39.565509 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3b469c2f-3bd0-428f-8780-213cb8df763e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:39.566509 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3b469c2f-3bd0-428f-8780-213cb8df763e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:39.572742 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3b469c2f-3bd0-428f-8780-213cb8df763e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:39.573107 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3b469c2f-3bd0-428f-8780-213cb8df763e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:39.575695 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3b469c2f-3bd0-428f-8780-213cb8df763e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:39.575695 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3b469c2f-3bd0-428f-8780-213cb8df763e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:39.582052 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e5273f65-4da9-47c9-9244-3788b48473b5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:39.582608 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e5273f65-4da9-47c9-9244-3788b48473b5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:39.590834 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e5273f65-4da9-47c9-9244-3788b48473b5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:39.591397 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e5273f65-4da9-47c9-9244-3788b48473b5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:39.592201 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e5273f65-4da9-47c9-9244-3788b48473b5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:39.592638 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e5273f65-4da9-47c9-9244-3788b48473b5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:39.708435 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3b469c2f-3bd0-428f-8780-213cb8df763e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 23801 microversion: 2.1 time: 0.147318 Jul 30 16:14:39.709605 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 565/1136] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:39 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 23801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:14:39.813825 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e5273f65-4da9-47c9-9244-3788b48473b5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:39.821852 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e5273f65-4da9-47c9-9244-3788b48473b5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:39.823590 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e5273f65-4da9-47c9-9244-3788b48473b5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:39.825476 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e5273f65-4da9-47c9-9244-3788b48473b5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1720 microversion: 2.20 time: 0.248474 Jul 30 16:14:39.826510 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 572/1137] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:39 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1720 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:40.389089 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8cde73df-8e6b-4042-8d54-e7bea313b817 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:40.389725 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8cde73df-8e6b-4042-8d54-e7bea313b817 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:40.396398 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8cde73df-8e6b-4042-8d54-e7bea313b817 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:40.396848 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8cde73df-8e6b-4042-8d54-e7bea313b817 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:40.397612 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8cde73df-8e6b-4042-8d54-e7bea313b817 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:40.398047 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8cde73df-8e6b-4042-8d54-e7bea313b817 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:40.524872 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8cde73df-8e6b-4042-8d54-e7bea313b817 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:40.532271 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8cde73df-8e6b-4042-8d54-e7bea313b817 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 200 len: 1267 microversion: 2.1 time: 0.147883 Jul 30 16:14:40.532829 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 566/1138] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:40 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:40.719409 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0bca866b-f631-40e7-8980-825b8d2c5ad3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:40.720319 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0bca866b-f631-40e7-8980-825b8d2c5ad3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:40.726472 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0bca866b-f631-40e7-8980-825b8d2c5ad3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:40.726915 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0bca866b-f631-40e7-8980-825b8d2c5ad3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:40.727699 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0bca866b-f631-40e7-8980-825b8d2c5ad3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:40.728126 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0bca866b-f631-40e7-8980-825b8d2c5ad3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:40.801360 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0bca866b-f631-40e7-8980-825b8d2c5ad3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 24410 microversion: 2.1 time: 0.085501 Jul 30 16:14:40.802405 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 573/1139] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:40 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 24410 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:14:40.844290 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-96b9d2ba-5702-4ad2-83f4-1f35e117efe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:40.844896 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-96b9d2ba-5702-4ad2-83f4-1f35e117efe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:40.851189 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-96b9d2ba-5702-4ad2-83f4-1f35e117efe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:40.851642 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-96b9d2ba-5702-4ad2-83f4-1f35e117efe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:40.852539 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-96b9d2ba-5702-4ad2-83f4-1f35e117efe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:40.852983 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-96b9d2ba-5702-4ad2-83f4-1f35e117efe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:40.973336 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-96b9d2ba-5702-4ad2-83f4-1f35e117efe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:40.981465 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-96b9d2ba-5702-4ad2-83f4-1f35e117efe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:40.982959 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-96b9d2ba-5702-4ad2-83f4-1f35e117efe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:40.984202 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-96b9d2ba-5702-4ad2-83f4-1f35e117efe8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1720 microversion: 2.20 time: 0.143923 Jul 30 16:14:40.984662 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 567/1140] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:40 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1720 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:41.549201 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-28338c36-6e7e-494c-ad8d-26cbd0a808c0 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:41.549823 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-28338c36-6e7e-494c-ad8d-26cbd0a808c0 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:41.556647 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-28338c36-6e7e-494c-ad8d-26cbd0a808c0 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:41.557177 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-28338c36-6e7e-494c-ad8d-26cbd0a808c0 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:41.557999 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-28338c36-6e7e-494c-ad8d-26cbd0a808c0 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:41.558960 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-28338c36-6e7e-494c-ad8d-26cbd0a808c0 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:41.680612 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-28338c36-6e7e-494c-ad8d-26cbd0a808c0 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:41.688518 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-28338c36-6e7e-494c-ad8d-26cbd0a808c0 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 200 len: 1454 microversion: 2.1 time: 0.143707 Jul 30 16:14:41.689072 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 574/1141] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:41 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:14:41.704046 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9e0b9b8e-08c1-445c-a61f-927f4f69b9b6 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:41.704655 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9e0b9b8e-08c1-445c-a61f-927f4f69b9b6 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:41.710776 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9e0b9b8e-08c1-445c-a61f-927f4f69b9b6 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:41.711254 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9e0b9b8e-08c1-445c-a61f-927f4f69b9b6 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:41.712024 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9e0b9b8e-08c1-445c-a61f-927f4f69b9b6 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:41.712454 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9e0b9b8e-08c1-445c-a61f-927f4f69b9b6 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:41.812933 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a314d117-c089-424e-b895-a7606e14542a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:41.813952 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a314d117-c089-424e-b895-a7606e14542a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:41.820108 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a314d117-c089-424e-b895-a7606e14542a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:41.820553 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a314d117-c089-424e-b895-a7606e14542a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:41.821318 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a314d117-c089-424e-b895-a7606e14542a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:41.821747 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a314d117-c089-424e-b895-a7606e14542a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:41.844726 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9e0b9b8e-08c1-445c-a61f-927f4f69b9b6 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:41.853453 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9e0b9b8e-08c1-445c-a61f-927f4f69b9b6 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 200 len: 1454 microversion: 2.1 time: 0.153004 Jul 30 16:14:41.854037 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 568/1142] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:41 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:41.889554 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a314d117-c089-424e-b895-a7606e14542a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 25197 microversion: 2.1 time: 0.080984 Jul 30 16:14:41.890565 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 575/1143] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:41 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 25197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:14:42.002252 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-965989d6-62cc-4b76-b091-c1af0b887e08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:42.002884 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-965989d6-62cc-4b76-b091-c1af0b887e08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:42.008717 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-965989d6-62cc-4b76-b091-c1af0b887e08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:42.009168 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-965989d6-62cc-4b76-b091-c1af0b887e08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:42.009934 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-965989d6-62cc-4b76-b091-c1af0b887e08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:42.010367 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-965989d6-62cc-4b76-b091-c1af0b887e08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:42.131461 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-965989d6-62cc-4b76-b091-c1af0b887e08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:42.139255 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-965989d6-62cc-4b76-b091-c1af0b887e08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:42.140767 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-965989d6-62cc-4b76-b091-c1af0b887e08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:42.141898 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-965989d6-62cc-4b76-b091-c1af0b887e08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1720 microversion: 2.20 time: 0.143385 Jul 30 16:14:42.142443 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 569/1144] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:41 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1720 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:42.902793 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0a2a3e2b-cbb7-4ace-91cb-45cbd1b51207 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:42.903913 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0a2a3e2b-cbb7-4ace-91cb-45cbd1b51207 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:42.910840 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0a2a3e2b-cbb7-4ace-91cb-45cbd1b51207 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:42.911347 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0a2a3e2b-cbb7-4ace-91cb-45cbd1b51207 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:42.912164 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0a2a3e2b-cbb7-4ace-91cb-45cbd1b51207 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:42.912599 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0a2a3e2b-cbb7-4ace-91cb-45cbd1b51207 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:43.041609 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0a2a3e2b-cbb7-4ace-91cb-45cbd1b51207 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 26157 microversion: 2.1 time: 0.143718 Jul 30 16:14:43.047103 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 576/1145] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:42 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 26157 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:14:43.163283 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c91b17e6-a365-4fc0-a20f-663b30853354 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:43.164337 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c91b17e6-a365-4fc0-a20f-663b30853354 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:43.174288 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c91b17e6-a365-4fc0-a20f-663b30853354 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:43.174554 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c91b17e6-a365-4fc0-a20f-663b30853354 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:43.175765 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c91b17e6-a365-4fc0-a20f-663b30853354 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:43.176078 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c91b17e6-a365-4fc0-a20f-663b30853354 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:43.344961 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-19298d06-65f2-4094-9528-19420777050e req-c72ac534-7e97-4ffe-a53e-016827f11104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde02f58-42c0-417a-94c5-7b65163fb5f2", "name": "network-vif-unplugged", "status": "completed", "tag": "4308e410-9d50-4a55-b027-a6d836a99289"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:43.347488 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:14:43.347488 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:14:43.360083 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-19298d06-65f2-4094-9528-19420777050e req-c72ac534-7e97-4ffe-a53e-016827f11104 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:43.360837 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-19298d06-65f2-4094-9528-19420777050e req-c72ac534-7e97-4ffe-a53e-016827f11104 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:43.372327 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c91b17e6-a365-4fc0-a20f-663b30853354 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:43.383039 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.compute.server_external_events [req-19298d06-65f2-4094-9528-19420777050e req-c72ac534-7e97-4ffe-a53e-016827f11104 service nova] Unable to find a host for instance cde02f58-42c0-417a-94c5-7b65163fb5f2. Dropping event network-vif-unplugged {{(pid=107453) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jul 30 16:14:43.384321 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-19298d06-65f2-4094-9528-19420777050e req-c72ac534-7e97-4ffe-a53e-016827f11104 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045423 Jul 30 16:14:43.385243 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 577/1146] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:14:43 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 30 16:14:43.386127 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c91b17e6-a365-4fc0-a20f-663b30853354 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:43.389419 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c91b17e6-a365-4fc0-a20f-663b30853354 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:43.391438 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c91b17e6-a365-4fc0-a20f-663b30853354 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1663 microversion: 2.20 time: 0.234064 Jul 30 16:14:43.392602 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 570/1147] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:43 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1663 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:14:43.415286 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f1df8aed-ed93-4be8-a08e-42df583cc20a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac028e60-374c-45ee-9846-70a036b32622"}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:43.416901 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f1df8aed-ed93-4be8-a08e-42df583cc20a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:43.425938 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f1df8aed-ed93-4be8-a08e-42df583cc20a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:43.427696 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f1df8aed-ed93-4be8-a08e-42df583cc20a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:43.429094 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f1df8aed-ed93-4be8-a08e-42df583cc20a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:43.429548 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f1df8aed-ed93-4be8-a08e-42df583cc20a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:43.770266 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f1df8aed-ed93-4be8-a08e-42df583cc20a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.359912 Jul 30 16:14:43.771147 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 578/1148] 10.222.0.37 () {62 vars in 1364 bytes} [Fri Jul 30 16:14:43 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/os-volume_attachments => generated 188 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:14:43.837592 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-dbdd13f5-50d6-4d5c-9a3a-34a4ef0c88e8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:43.838094 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-dbdd13f5-50d6-4d5c-9a3a-34a4ef0c88e8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:43.844791 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dbdd13f5-50d6-4d5c-9a3a-34a4ef0c88e8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:43.845242 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dbdd13f5-50d6-4d5c-9a3a-34a4ef0c88e8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:43.846032 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dbdd13f5-50d6-4d5c-9a3a-34a4ef0c88e8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:43.846467 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-dbdd13f5-50d6-4d5c-9a3a-34a4ef0c88e8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:44.056293 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2ea1ea99-c170-4b6c-be24-ea573dfe4426 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:44.057500 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-2ea1ea99-c170-4b6c-be24-ea573dfe4426 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:44.066508 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2ea1ea99-c170-4b6c-be24-ea573dfe4426 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:44.066961 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2ea1ea99-c170-4b6c-be24-ea573dfe4426 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:44.067853 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2ea1ea99-c170-4b6c-be24-ea573dfe4426 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:44.068291 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2ea1ea99-c170-4b6c-be24-ea573dfe4426 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:44.135776 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-dbdd13f5-50d6-4d5c-9a3a-34a4ef0c88e8 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "DELETE /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/os-volume_attachments/ac028e60-374c-45ee-9846-70a036b32622" status: 202 len: 0 microversion: 2.20 time: 0.302158 Jul 30 16:14:44.136363 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 571/1149] 10.222.0.37 () {60 vars in 1457 bytes} [Fri Jul 30 16:14:43 2021] DELETE /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/os-volume_attachments/ac028e60-374c-45ee-9846-70a036b32622 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 30 16:14:44.145772 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-3a04a2c0-adba-4cfb-8094-ba7a5638c873 req-a9a23926-4193-4c3e-8195-e96e47e38c8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36700cb8-81e3-47e4-96f9-9b417e29aef8", "tag": "1d4d5279-4d0d-4100-9111-bce087569c04"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:44.148295 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:14:44.148295 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:14:44.155012 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2ea1ea99-c170-4b6c-be24-ea573dfe4426 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 27032 microversion: 2.1 time: 0.100184 Jul 30 16:14:44.156134 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 579/1150] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:44 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 27032 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:14:44.159468 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-3a04a2c0-adba-4cfb-8094-ba7a5638c873 req-a9a23926-4193-4c3e-8195-e96e47e38c8a service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:44.160244 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-3a04a2c0-adba-4cfb-8094-ba7a5638c873 req-a9a23926-4193-4c3e-8195-e96e47e38c8a service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:44.173712 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-3a04a2c0-adba-4cfb-8094-ba7a5638c873 req-a9a23926-4193-4c3e-8195-e96e47e38c8a service nova] Creating event network-changed:1d4d5279-4d0d-4100-9111-bce087569c04 for instance 36700cb8-81e3-47e4-96f9-9b417e29aef8 on hv-cinder-80304 Jul 30 16:14:44.178695 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-3a04a2c0-adba-4cfb-8094-ba7a5638c873 req-a9a23926-4193-4c3e-8195-e96e47e38c8a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037059 Jul 30 16:14:44.179468 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 572/1151] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:14:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:14:44.221347 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ffc1129f-e17d-49e4-954f-38d05e14af9b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:44.222082 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ffc1129f-e17d-49e4-954f-38d05e14af9b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:44.228768 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ffc1129f-e17d-49e4-954f-38d05e14af9b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:44.229302 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ffc1129f-e17d-49e4-954f-38d05e14af9b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:44.231030 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ffc1129f-e17d-49e4-954f-38d05e14af9b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:44.231682 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ffc1129f-e17d-49e4-954f-38d05e14af9b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:44.314773 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ffc1129f-e17d-49e4-954f-38d05e14af9b tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action" status: 202 len: 0 microversion: 2.20 time: 0.097543 Jul 30 16:14:44.315740 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 580/1152] 10.222.0.37 () {62 vars in 1319 bytes} [Fri Jul 30 16:14:44 2021] POST /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 30 16:14:44.325222 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-722d5917-b864-46c5-9f8a-50c3cb1729bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:44.325345 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-722d5917-b864-46c5-9f8a-50c3cb1729bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:44.331651 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-722d5917-b864-46c5-9f8a-50c3cb1729bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:44.332093 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-722d5917-b864-46c5-9f8a-50c3cb1729bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:44.332869 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-722d5917-b864-46c5-9f8a-50c3cb1729bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:44.333299 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-722d5917-b864-46c5-9f8a-50c3cb1729bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:44.505683 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-722d5917-b864-46c5-9f8a-50c3cb1729bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:44.514650 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-722d5917-b864-46c5-9f8a-50c3cb1729bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:44.517436 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-722d5917-b864-46c5-9f8a-50c3cb1729bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:44.518679 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-722d5917-b864-46c5-9f8a-50c3cb1729bd tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1671 microversion: 2.20 time: 0.198550 Jul 30 16:14:44.519371 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 573/1153] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:44 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1671 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:14:45.167400 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4c9c0c27-b6c5-460a-bb25-38fa60fd65a6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:45.169617 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4c9c0c27-b6c5-460a-bb25-38fa60fd65a6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:45.175785 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4c9c0c27-b6c5-460a-bb25-38fa60fd65a6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:45.176232 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4c9c0c27-b6c5-460a-bb25-38fa60fd65a6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:45.177021 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4c9c0c27-b6c5-460a-bb25-38fa60fd65a6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:45.177459 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4c9c0c27-b6c5-460a-bb25-38fa60fd65a6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:45.253903 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4c9c0c27-b6c5-460a-bb25-38fa60fd65a6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 27576 microversion: 2.1 time: 0.090112 Jul 30 16:14:45.254658 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 581/1154] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:45 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 27576 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:14:45.538805 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-66a07380-bf18-4736-ada7-dbc27479b74d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:45.539592 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-66a07380-bf18-4736-ada7-dbc27479b74d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:45.546317 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-66a07380-bf18-4736-ada7-dbc27479b74d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:45.546926 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-66a07380-bf18-4736-ada7-dbc27479b74d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:45.547890 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-66a07380-bf18-4736-ada7-dbc27479b74d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:45.548330 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-66a07380-bf18-4736-ada7-dbc27479b74d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:45.672206 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-66a07380-bf18-4736-ada7-dbc27479b74d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:45.681678 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-66a07380-bf18-4736-ada7-dbc27479b74d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:45.683624 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-66a07380-bf18-4736-ada7-dbc27479b74d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:45.684932 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-66a07380-bf18-4736-ada7-dbc27479b74d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1729 microversion: 2.20 time: 0.149849 Jul 30 16:14:45.685490 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 574/1155] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:45 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:46.266884 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-fc2913e6-ad74-4b60-bd05-b7894469b0e3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:46.267902 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-fc2913e6-ad74-4b60-bd05-b7894469b0e3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:46.274680 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fc2913e6-ad74-4b60-bd05-b7894469b0e3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:46.275063 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fc2913e6-ad74-4b60-bd05-b7894469b0e3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:46.275864 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fc2913e6-ad74-4b60-bd05-b7894469b0e3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:46.276488 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fc2913e6-ad74-4b60-bd05-b7894469b0e3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:46.369262 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-fc2913e6-ad74-4b60-bd05-b7894469b0e3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 27886 microversion: 2.1 time: 0.106543 Jul 30 16:14:46.369909 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 582/1156] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:46 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 27886 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:14:46.705863 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1b1a5e4c-49ea-47f5-a7d2-e7a597344df2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:46.707466 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1b1a5e4c-49ea-47f5-a7d2-e7a597344df2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:46.716254 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1b1a5e4c-49ea-47f5-a7d2-e7a597344df2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:46.720639 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1b1a5e4c-49ea-47f5-a7d2-e7a597344df2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:46.725246 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1b1a5e4c-49ea-47f5-a7d2-e7a597344df2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:46.725997 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1b1a5e4c-49ea-47f5-a7d2-e7a597344df2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:46.891280 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1b1a5e4c-49ea-47f5-a7d2-e7a597344df2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:46.899871 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1b1a5e4c-49ea-47f5-a7d2-e7a597344df2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:46.901368 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1b1a5e4c-49ea-47f5-a7d2-e7a597344df2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:46.902581 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1b1a5e4c-49ea-47f5-a7d2-e7a597344df2 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1729 microversion: 2.20 time: 0.201807 Jul 30 16:14:46.903159 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 575/1157] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:46 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:47.381434 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8036fa92-2e8e-43a0-ab02-787fff4ceb7a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:47.382437 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-8036fa92-2e8e-43a0-ab02-787fff4ceb7a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:47.389212 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8036fa92-2e8e-43a0-ab02-787fff4ceb7a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:47.389669 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8036fa92-2e8e-43a0-ab02-787fff4ceb7a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:47.390487 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8036fa92-2e8e-43a0-ab02-787fff4ceb7a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:47.390900 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8036fa92-2e8e-43a0-ab02-787fff4ceb7a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:47.921062 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-58951923-30a2-4633-8dc0-d67e016d9e5f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:47.921599 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-58951923-30a2-4633-8dc0-d67e016d9e5f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:47.928451 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-58951923-30a2-4633-8dc0-d67e016d9e5f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:47.929045 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-58951923-30a2-4633-8dc0-d67e016d9e5f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:47.929975 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-58951923-30a2-4633-8dc0-d67e016d9e5f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:47.930416 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-58951923-30a2-4633-8dc0-d67e016d9e5f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:48.056302 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-58951923-30a2-4633-8dc0-d67e016d9e5f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:48.064601 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-58951923-30a2-4633-8dc0-d67e016d9e5f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:48.066071 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-58951923-30a2-4633-8dc0-d67e016d9e5f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:48.067216 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-58951923-30a2-4633-8dc0-d67e016d9e5f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1729 microversion: 2.20 time: 0.150511 Jul 30 16:14:48.067763 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 576/1158] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:47 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:14:49.085662 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-418b9af8-e0d4-49ea-892c-e8d8063d4611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:49.086344 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-418b9af8-e0d4-49ea-892c-e8d8063d4611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:49.092316 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-418b9af8-e0d4-49ea-892c-e8d8063d4611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:49.092764 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-418b9af8-e0d4-49ea-892c-e8d8063d4611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:49.093537 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-418b9af8-e0d4-49ea-892c-e8d8063d4611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:49.093971 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-418b9af8-e0d4-49ea-892c-e8d8063d4611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:49.218476 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-418b9af8-e0d4-49ea-892c-e8d8063d4611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:49.227668 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-418b9af8-e0d4-49ea-892c-e8d8063d4611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:49.229200 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-418b9af8-e0d4-49ea-892c-e8d8063d4611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:49.230371 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-418b9af8-e0d4-49ea-892c-e8d8063d4611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1729 microversion: 2.20 time: 0.148746 Jul 30 16:14:49.231088 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 577/1159] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:49 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:14:50.249342 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-fdf45531-04cd-458d-98e3-52bb42f24a96 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:50.250028 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-fdf45531-04cd-458d-98e3-52bb42f24a96 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:50.256083 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fdf45531-04cd-458d-98e3-52bb42f24a96 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:50.256531 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fdf45531-04cd-458d-98e3-52bb42f24a96 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:50.257291 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fdf45531-04cd-458d-98e3-52bb42f24a96 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:50.257724 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fdf45531-04cd-458d-98e3-52bb42f24a96 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:50.390105 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-fdf45531-04cd-458d-98e3-52bb42f24a96 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:50.398068 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-fdf45531-04cd-458d-98e3-52bb42f24a96 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:50.399592 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-fdf45531-04cd-458d-98e3-52bb42f24a96 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:50.400846 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-fdf45531-04cd-458d-98e3-52bb42f24a96 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1729 microversion: 2.20 time: 0.155242 Jul 30 16:14:50.401405 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 578/1160] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:50 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:14:51.419607 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9109004c-07b9-458a-8344-f89fee251589 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:51.420227 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9109004c-07b9-458a-8344-f89fee251589 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:51.426099 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9109004c-07b9-458a-8344-f89fee251589 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:51.426548 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9109004c-07b9-458a-8344-f89fee251589 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:51.427417 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9109004c-07b9-458a-8344-f89fee251589 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:51.427852 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9109004c-07b9-458a-8344-f89fee251589 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:51.553338 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9109004c-07b9-458a-8344-f89fee251589 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:51.562675 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9109004c-07b9-458a-8344-f89fee251589 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:51.564270 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-9109004c-07b9-458a-8344-f89fee251589 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:51.565724 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9109004c-07b9-458a-8344-f89fee251589 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1729 microversion: 2.20 time: 0.150464 Jul 30 16:14:51.567217 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 579/1161] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:51 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:14:51.823545 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0191f145-3392-4b5c-950f-aa23925deafb tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-163531103", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1170790236", "security_groups": [{"name": "tempest-secgroup-smoke-805035273"}], "networks": [{"uuid": "d8bbea9d-01fd-40bb-ae9f-25c041888307"}], "block_device_mapping_v2": [{"uuid": "d3e34e19-1e6a-47c7-8c27-de73591b8040", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:51.935676 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.network.neutron [None req-0191f145-3392-4b5c-950f-aa23925deafb tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] validate_networks() for [('d8bbea9d-01fd-40bb-ae9f-25c041888307', None, None, None)] {{(pid=107452) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:14:52.335606 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-0191f145-3392-4b5c-950f-aa23925deafb tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Flavor limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:14:52.336029 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-0191f145-3392-4b5c-950f-aa23925deafb tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Image limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:14:52.336506 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-0191f145-3392-4b5c-950f-aa23925deafb tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Flavor pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:14:52.336909 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-0191f145-3392-4b5c-950f-aa23925deafb tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Image pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:14:52.337318 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-0191f145-3392-4b5c-950f-aa23925deafb tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:14:52.345874 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0191f145-3392-4b5c-950f-aa23925deafb tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:52.346317 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0191f145-3392-4b5c-950f-aa23925deafb tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:52.347114 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0191f145-3392-4b5c-950f-aa23925deafb tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:52.347579 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0191f145-3392-4b5c-950f-aa23925deafb tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:52.364401 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-0191f145-3392-4b5c-950f-aa23925deafb tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Getting quotas for project 3c425ffd8fd041f9b548ee591a2bd843. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:14:52.368266 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-0191f145-3392-4b5c-950f-aa23925deafb tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Getting quotas for user 96cd6f5201214bcea8ba2ca2acaaab13 and project 3c425ffd8fd041f9b548ee591a2bd843. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:14:52.429694 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0191f145-3392-4b5c-950f-aa23925deafb tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Going to run 1 instances... {{(pid=107452) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:14:52.431952 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0191f145-3392-4b5c-950f-aa23925deafb tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3e34e19-1e6a-47c7-8c27-de73591b8040',volume_size=None,volume_type=None)] {{(pid=107452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:14:52.562969 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0191f145-3392-4b5c-950f-aa23925deafb tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.742952 Jul 30 16:14:52.563651 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 580/1162] 10.222.0.37 () {60 vars in 1147 bytes} [Fri Jul 30 16:14:51 2021] POST /compute/v2.1/servers => generated 405 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 16:14:52.573254 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0f10ba8d-ba64-449f-a981-6884fff32908 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:52.573871 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0f10ba8d-ba64-449f-a981-6884fff32908 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:52.634201 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0f10ba8d-ba64-449f-a981-6884fff32908 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:52.645415 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0f10ba8d-ba64-449f-a981-6884fff32908 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1088 microversion: 2.1 time: 0.075858 Jul 30 16:14:52.646018 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 581/1163] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:52 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1088 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:14:52.650554 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3e81d88b-7ae6-4580-a251-76f22d515845 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:52.651352 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3e81d88b-7ae6-4580-a251-76f22d515845 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:52.660585 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3e81d88b-7ae6-4580-a251-76f22d515845 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:52.660986 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3e81d88b-7ae6-4580-a251-76f22d515845 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:52.661772 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3e81d88b-7ae6-4580-a251-76f22d515845 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:52.662206 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3e81d88b-7ae6-4580-a251-76f22d515845 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:52.802939 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-3e81d88b-7ae6-4580-a251-76f22d515845 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:52.811164 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-3e81d88b-7ae6-4580-a251-76f22d515845 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:52.812592 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-3e81d88b-7ae6-4580-a251-76f22d515845 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:52.813735 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3e81d88b-7ae6-4580-a251-76f22d515845 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1729 microversion: 2.20 time: 0.166539 Jul 30 16:14:52.819194 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 582/1164] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:52 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:14:53.661787 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c9a473ce-5233-4264-b212-19fa0d5958aa tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:53.662465 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c9a473ce-5233-4264-b212-19fa0d5958aa tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:53.668386 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c9a473ce-5233-4264-b212-19fa0d5958aa tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:53.668937 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c9a473ce-5233-4264-b212-19fa0d5958aa tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:53.669694 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c9a473ce-5233-4264-b212-19fa0d5958aa tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:53.670125 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c9a473ce-5233-4264-b212-19fa0d5958aa tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:53.734110 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c9a473ce-5233-4264-b212-19fa0d5958aa tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:53.741452 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c9a473ce-5233-4264-b212-19fa0d5958aa tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1138 microversion: 2.1 time: 0.083523 Jul 30 16:14:53.742016 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 583/1165] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:53 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:14:53.832348 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-898a2b47-f23e-42a2-8d0f-86d0fef06243 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:53.832953 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-898a2b47-f23e-42a2-8d0f-86d0fef06243 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:53.838858 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-898a2b47-f23e-42a2-8d0f-86d0fef06243 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:53.839354 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-898a2b47-f23e-42a2-8d0f-86d0fef06243 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:53.840120 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-898a2b47-f23e-42a2-8d0f-86d0fef06243 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:53.841197 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-898a2b47-f23e-42a2-8d0f-86d0fef06243 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:53.980740 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-898a2b47-f23e-42a2-8d0f-86d0fef06243 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:53.989453 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-898a2b47-f23e-42a2-8d0f-86d0fef06243 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:53.991054 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-898a2b47-f23e-42a2-8d0f-86d0fef06243 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:53.992430 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-898a2b47-f23e-42a2-8d0f-86d0fef06243 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1729 microversion: 2.20 time: 0.163680 Jul 30 16:14:53.993205 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 584/1166] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:53 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:14:54.757748 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c0a500d3-8589-4811-9659-139f36cc41ac tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:54.758561 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c0a500d3-8589-4811-9659-139f36cc41ac tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:54.765522 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c0a500d3-8589-4811-9659-139f36cc41ac tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:54.765975 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c0a500d3-8589-4811-9659-139f36cc41ac tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:54.766751 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c0a500d3-8589-4811-9659-139f36cc41ac tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:54.767206 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c0a500d3-8589-4811-9659-139f36cc41ac tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:54.827775 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c0a500d3-8589-4811-9659-139f36cc41ac tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:54.835074 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c0a500d3-8589-4811-9659-139f36cc41ac tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1138 microversion: 2.1 time: 0.081230 Jul 30 16:14:54.835693 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 585/1167] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:54 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1138 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:14:55.012373 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6792eaba-9e8d-4938-980c-aa21687fa6ac tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:55.012911 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6792eaba-9e8d-4938-980c-aa21687fa6ac tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:55.019406 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6792eaba-9e8d-4938-980c-aa21687fa6ac tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:55.019848 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6792eaba-9e8d-4938-980c-aa21687fa6ac tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:55.020648 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6792eaba-9e8d-4938-980c-aa21687fa6ac tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:55.021072 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6792eaba-9e8d-4938-980c-aa21687fa6ac tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:55.155542 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6792eaba-9e8d-4938-980c-aa21687fa6ac tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:55.167908 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6792eaba-9e8d-4938-980c-aa21687fa6ac tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:55.169875 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6792eaba-9e8d-4938-980c-aa21687fa6ac tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:55.171892 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6792eaba-9e8d-4938-980c-aa21687fa6ac tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1729 microversion: 2.20 time: 0.163206 Jul 30 16:14:55.181206 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 586/1168] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:55 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:14:55.853309 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-68f2e6bb-7743-4687-8e3f-204b42048517 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:55.854078 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-68f2e6bb-7743-4687-8e3f-204b42048517 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:55.860918 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-68f2e6bb-7743-4687-8e3f-204b42048517 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:55.861746 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-68f2e6bb-7743-4687-8e3f-204b42048517 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:55.862530 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-68f2e6bb-7743-4687-8e3f-204b42048517 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:55.862968 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-68f2e6bb-7743-4687-8e3f-204b42048517 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:55.925681 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-68f2e6bb-7743-4687-8e3f-204b42048517 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:55.934100 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-68f2e6bb-7743-4687-8e3f-204b42048517 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1138 microversion: 2.1 time: 0.084349 Jul 30 16:14:55.935299 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 587/1169] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:55 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:56.190564 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-65c716aa-b2ef-4e33-94e3-0367bd0cf709 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:56.191119 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-65c716aa-b2ef-4e33-94e3-0367bd0cf709 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:56.197032 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-65c716aa-b2ef-4e33-94e3-0367bd0cf709 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:56.197527 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-65c716aa-b2ef-4e33-94e3-0367bd0cf709 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:56.198250 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-65c716aa-b2ef-4e33-94e3-0367bd0cf709 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:56.198686 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-65c716aa-b2ef-4e33-94e3-0367bd0cf709 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:56.338171 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-65c716aa-b2ef-4e33-94e3-0367bd0cf709 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:56.347164 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-65c716aa-b2ef-4e33-94e3-0367bd0cf709 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:56.348689 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-65c716aa-b2ef-4e33-94e3-0367bd0cf709 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:56.349994 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-65c716aa-b2ef-4e33-94e3-0367bd0cf709 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1729 microversion: 2.20 time: 0.163395 Jul 30 16:14:56.351055 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 588/1170] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:56 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:14:56.949998 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-021d8ff9-4463-47b2-9c62-27810a2559b7 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:56.950727 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-021d8ff9-4463-47b2-9c62-27810a2559b7 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:56.956826 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-021d8ff9-4463-47b2-9c62-27810a2559b7 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:56.957269 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-021d8ff9-4463-47b2-9c62-27810a2559b7 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:56.958043 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-021d8ff9-4463-47b2-9c62-27810a2559b7 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:56.958477 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-021d8ff9-4463-47b2-9c62-27810a2559b7 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:57.018678 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-021d8ff9-4463-47b2-9c62-27810a2559b7 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:57.026620 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-021d8ff9-4463-47b2-9c62-27810a2559b7 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1138 microversion: 2.1 time: 0.080161 Jul 30 16:14:57.027242 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 589/1171] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:56 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1138 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:14:57.368485 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c26a5e70-c601-41cf-915e-efe34690a42d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:57.369085 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c26a5e70-c601-41cf-915e-efe34690a42d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:57.375093 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c26a5e70-c601-41cf-915e-efe34690a42d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:57.375574 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c26a5e70-c601-41cf-915e-efe34690a42d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:57.376329 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c26a5e70-c601-41cf-915e-efe34690a42d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:57.376760 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c26a5e70-c601-41cf-915e-efe34690a42d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:57.502655 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c26a5e70-c601-41cf-915e-efe34690a42d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:57.510433 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c26a5e70-c601-41cf-915e-efe34690a42d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:57.512108 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c26a5e70-c601-41cf-915e-efe34690a42d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:57.513387 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c26a5e70-c601-41cf-915e-efe34690a42d tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1729 microversion: 2.20 time: 0.148643 Jul 30 16:14:57.514212 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 590/1172] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:57 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:14:58.042713 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f9100bc2-a9cb-45b5-b93b-1c51be0077b0 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:58.043377 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f9100bc2-a9cb-45b5-b93b-1c51be0077b0 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:58.049979 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f9100bc2-a9cb-45b5-b93b-1c51be0077b0 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:58.050424 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f9100bc2-a9cb-45b5-b93b-1c51be0077b0 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:58.051221 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f9100bc2-a9cb-45b5-b93b-1c51be0077b0 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:58.051658 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f9100bc2-a9cb-45b5-b93b-1c51be0077b0 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:58.112551 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f9100bc2-a9cb-45b5-b93b-1c51be0077b0 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:58.119735 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f9100bc2-a9cb-45b5-b93b-1c51be0077b0 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1138 microversion: 2.1 time: 0.080734 Jul 30 16:14:58.120289 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 591/1173] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:58 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1138 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:14:58.533651 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-aff6af81-0170-43d3-92c4-0a1cab90b048 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:58.534257 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-aff6af81-0170-43d3-92c4-0a1cab90b048 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:58.540114 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aff6af81-0170-43d3-92c4-0a1cab90b048 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:58.540564 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aff6af81-0170-43d3-92c4-0a1cab90b048 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:58.541321 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aff6af81-0170-43d3-92c4-0a1cab90b048 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:58.541753 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-aff6af81-0170-43d3-92c4-0a1cab90b048 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:58.666307 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-aff6af81-0170-43d3-92c4-0a1cab90b048 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:58.674129 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-aff6af81-0170-43d3-92c4-0a1cab90b048 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:58.675626 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-aff6af81-0170-43d3-92c4-0a1cab90b048 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:58.676739 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-aff6af81-0170-43d3-92c4-0a1cab90b048 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1729 microversion: 2.20 time: 0.146840 Jul 30 16:14:58.677287 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 592/1174] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:58 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1729 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:14:58.778433 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8036fa92-2e8e-43a0-ab02-787fff4ceb7a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 28643 microversion: 2.1 time: 11.400778 Jul 30 16:14:58.782515 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 583/1175] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:47 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 28643 bytes in 11403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:14:59.135312 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-7ce94611-8416-467e-9593-05ae01470e88 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:59.135911 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7ce94611-8416-467e-9593-05ae01470e88 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:59.141726 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7ce94611-8416-467e-9593-05ae01470e88 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:59.142170 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7ce94611-8416-467e-9593-05ae01470e88 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:59.142930 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7ce94611-8416-467e-9593-05ae01470e88 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:59.143383 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7ce94611-8416-467e-9593-05ae01470e88 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:59.202012 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-7ce94611-8416-467e-9593-05ae01470e88 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:59.209161 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-7ce94611-8416-467e-9593-05ae01470e88 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1186 microversion: 2.1 time: 0.077625 Jul 30 16:14:59.209726 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 593/1176] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:14:59 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1186 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:14:59.695744 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f213fe2a-ac57-41e6-bcfb-8a73e5794c08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:14:59.696433 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f213fe2a-ac57-41e6-bcfb-8a73e5794c08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:59.703043 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f213fe2a-ac57-41e6-bcfb-8a73e5794c08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:59.703542 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f213fe2a-ac57-41e6-bcfb-8a73e5794c08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:59.704306 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f213fe2a-ac57-41e6-bcfb-8a73e5794c08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:59.704750 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f213fe2a-ac57-41e6-bcfb-8a73e5794c08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:59.789762 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-37f96e3f-e938-4fd8-aeea-cd80625a9988 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:14:59.790733 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-37f96e3f-e938-4fd8-aeea-cd80625a9988 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:14:59.797252 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-37f96e3f-e938-4fd8-aeea-cd80625a9988 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:59.797702 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-37f96e3f-e938-4fd8-aeea-cd80625a9988 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:59.798476 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-37f96e3f-e938-4fd8-aeea-cd80625a9988 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:14:59.798911 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-37f96e3f-e938-4fd8-aeea-cd80625a9988 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:14:59.862411 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-37f96e3f-e938-4fd8-aeea-cd80625a9988 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 28643 microversion: 2.1 time: 0.076022 Jul 30 16:14:59.863032 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 594/1177] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:14:59 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 28643 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:14:59.892346 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f213fe2a-ac57-41e6-bcfb-8a73e5794c08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:59.901381 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f213fe2a-ac57-41e6-bcfb-8a73e5794c08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:59.903039 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f213fe2a-ac57-41e6-bcfb-8a73e5794c08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:14:59.904813 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f213fe2a-ac57-41e6-bcfb-8a73e5794c08 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1729 microversion: 2.20 time: 0.213160 Jul 30 16:14:59.905549 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 584/1178] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:14:59 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1729 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:15:00.228372 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8b30f8f1-b3bb-41d0-bc5b-e4f869578fd2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:00.229069 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8b30f8f1-b3bb-41d0-bc5b-e4f869578fd2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:00.236283 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8b30f8f1-b3bb-41d0-bc5b-e4f869578fd2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:00.237992 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8b30f8f1-b3bb-41d0-bc5b-e4f869578fd2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:00.237992 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8b30f8f1-b3bb-41d0-bc5b-e4f869578fd2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:00.238243 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8b30f8f1-b3bb-41d0-bc5b-e4f869578fd2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:00.376554 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8b30f8f1-b3bb-41d0-bc5b-e4f869578fd2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:00.385580 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8b30f8f1-b3bb-41d0-bc5b-e4f869578fd2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1259 microversion: 2.1 time: 0.162228 Jul 30 16:15:00.386234 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 595/1179] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:00 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:15:00.818598 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-64b231d2-09f5-476b-b0c9-58eb75a1fa8d req-b7d524f1-fd8f-4878-8e4c-a46c94186fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a", "tag": "aeca0f4b-877a-4418-be7e-80555a5d3358"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:00.820199 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:15:00.820199 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:15:00.828561 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-64b231d2-09f5-476b-b0c9-58eb75a1fa8d req-b7d524f1-fd8f-4878-8e4c-a46c94186fc0 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:00.829007 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-64b231d2-09f5-476b-b0c9-58eb75a1fa8d req-b7d524f1-fd8f-4878-8e4c-a46c94186fc0 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:00.849074 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-64b231d2-09f5-476b-b0c9-58eb75a1fa8d req-b7d524f1-fd8f-4878-8e4c-a46c94186fc0 service nova] Creating event network-changed:aeca0f4b-877a-4418-be7e-80555a5d3358 for instance d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a on hv-cinder-80304 Jul 30 16:15:00.854260 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-64b231d2-09f5-476b-b0c9-58eb75a1fa8d req-b7d524f1-fd8f-4878-8e4c-a46c94186fc0 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039244 Jul 30 16:15:00.855049 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 585/1180] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:15:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:15:00.875581 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f5230ff0-75ba-4842-a174-e6efd4b9d390 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:00.876537 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f5230ff0-75ba-4842-a174-e6efd4b9d390 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:00.883715 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f5230ff0-75ba-4842-a174-e6efd4b9d390 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:00.884164 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f5230ff0-75ba-4842-a174-e6efd4b9d390 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:00.885135 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f5230ff0-75ba-4842-a174-e6efd4b9d390 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:00.885734 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f5230ff0-75ba-4842-a174-e6efd4b9d390 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:00.924162 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ce8d6ad9-b8f7-4f8f-a95b-f6911f24cd38 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:00.925498 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ce8d6ad9-b8f7-4f8f-a95b-f6911f24cd38 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:00.931963 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ce8d6ad9-b8f7-4f8f-a95b-f6911f24cd38 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:00.932411 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ce8d6ad9-b8f7-4f8f-a95b-f6911f24cd38 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:00.933427 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ce8d6ad9-b8f7-4f8f-a95b-f6911f24cd38 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:00.934037 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ce8d6ad9-b8f7-4f8f-a95b-f6911f24cd38 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:00.954804 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f5230ff0-75ba-4842-a174-e6efd4b9d390 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 28643 microversion: 2.1 time: 0.083354 Jul 30 16:15:00.955645 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 596/1181] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:15:00 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 28643 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:15:01.117386 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ce8d6ad9-b8f7-4f8f-a95b-f6911f24cd38 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:01.126013 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ce8d6ad9-b8f7-4f8f-a95b-f6911f24cd38 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:01.127589 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ce8d6ad9-b8f7-4f8f-a95b-f6911f24cd38 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:01.128723 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ce8d6ad9-b8f7-4f8f-a95b-f6911f24cd38 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1729 microversion: 2.20 time: 0.208602 Jul 30 16:15:01.129287 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 586/1182] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:15:00 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:15:01.404334 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-01faf7c2-9a8c-4d77-952b-391ae341ecff tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:01.405848 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-01faf7c2-9a8c-4d77-952b-391ae341ecff tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:01.413005 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-01faf7c2-9a8c-4d77-952b-391ae341ecff tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:01.413461 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-01faf7c2-9a8c-4d77-952b-391ae341ecff tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:01.414254 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-01faf7c2-9a8c-4d77-952b-391ae341ecff tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:01.414693 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-01faf7c2-9a8c-4d77-952b-391ae341ecff tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:01.544486 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-01faf7c2-9a8c-4d77-952b-391ae341ecff tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:01.551952 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-01faf7c2-9a8c-4d77-952b-391ae341ecff tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1259 microversion: 2.1 time: 0.152293 Jul 30 16:15:01.552506 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 597/1183] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:01 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:15:01.968479 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-46393074-37b9-4f4a-8df4-2b058da58f6d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:01.969390 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-46393074-37b9-4f4a-8df4-2b058da58f6d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:01.975079 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-46393074-37b9-4f4a-8df4-2b058da58f6d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:01.975564 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-46393074-37b9-4f4a-8df4-2b058da58f6d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:01.976334 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-46393074-37b9-4f4a-8df4-2b058da58f6d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:01.976772 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-46393074-37b9-4f4a-8df4-2b058da58f6d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:02.050833 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-46393074-37b9-4f4a-8df4-2b058da58f6d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 28643 microversion: 2.1 time: 0.086588 Jul 30 16:15:02.054695 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 587/1184] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:15:01 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 28643 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:15:02.147453 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c3336d4a-3d8c-4c19-bdce-4f9d55c41953 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:02.148061 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c3336d4a-3d8c-4c19-bdce-4f9d55c41953 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:02.154691 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c3336d4a-3d8c-4c19-bdce-4f9d55c41953 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:02.155159 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c3336d4a-3d8c-4c19-bdce-4f9d55c41953 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:02.155933 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c3336d4a-3d8c-4c19-bdce-4f9d55c41953 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:02.156366 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c3336d4a-3d8c-4c19-bdce-4f9d55c41953 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:02.272976 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c3336d4a-3d8c-4c19-bdce-4f9d55c41953 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:02.280831 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c3336d4a-3d8c-4c19-bdce-4f9d55c41953 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:02.282328 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c3336d4a-3d8c-4c19-bdce-4f9d55c41953 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:02.283494 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c3336d4a-3d8c-4c19-bdce-4f9d55c41953 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1729 microversion: 2.20 time: 0.140033 Jul 30 16:15:02.284041 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 598/1185] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:15:02 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1729 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:15:02.568968 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b728ead5-c9a7-413f-ac92-da306274e119 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:02.569583 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b728ead5-c9a7-413f-ac92-da306274e119 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:02.576691 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b728ead5-c9a7-413f-ac92-da306274e119 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:02.577135 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b728ead5-c9a7-413f-ac92-da306274e119 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:02.577899 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b728ead5-c9a7-413f-ac92-da306274e119 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:02.578330 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b728ead5-c9a7-413f-ac92-da306274e119 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:02.709750 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-b728ead5-c9a7-413f-ac92-da306274e119 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:02.716898 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b728ead5-c9a7-413f-ac92-da306274e119 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1259 microversion: 2.1 time: 0.152054 Jul 30 16:15:02.717443 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 588/1186] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:02 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:15:03.063267 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ba3df9d1-d285-45a1-a703-6ec6a98565f3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:03.066662 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ba3df9d1-d285-45a1-a703-6ec6a98565f3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:03.081870 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ba3df9d1-d285-45a1-a703-6ec6a98565f3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:03.089608 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ba3df9d1-d285-45a1-a703-6ec6a98565f3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:03.095516 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ba3df9d1-d285-45a1-a703-6ec6a98565f3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:03.097733 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ba3df9d1-d285-45a1-a703-6ec6a98565f3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:03.214201 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ba3df9d1-d285-45a1-a703-6ec6a98565f3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 29564 microversion: 2.1 time: 0.155141 Jul 30 16:15:03.215043 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 599/1187] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:15:03 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 29564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:15:03.301420 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-5c9046f7-61c7-481e-8554-ad6dd8d01105 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:03.302035 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-5c9046f7-61c7-481e-8554-ad6dd8d01105 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:03.308109 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5c9046f7-61c7-481e-8554-ad6dd8d01105 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:03.308564 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5c9046f7-61c7-481e-8554-ad6dd8d01105 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:03.309338 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5c9046f7-61c7-481e-8554-ad6dd8d01105 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:03.310004 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-5c9046f7-61c7-481e-8554-ad6dd8d01105 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:03.438820 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-5c9046f7-61c7-481e-8554-ad6dd8d01105 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:03.448521 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-5c9046f7-61c7-481e-8554-ad6dd8d01105 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:03.450738 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-5c9046f7-61c7-481e-8554-ad6dd8d01105 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:03.452373 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-5c9046f7-61c7-481e-8554-ad6dd8d01105 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1729 microversion: 2.20 time: 0.154783 Jul 30 16:15:03.453355 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-440a1788-ef31-4bb8-9716-e0b681df131d req-7b78fb9f-45f8-4482-8c60-ee5036b80683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde02f58-42c0-417a-94c5-7b65163fb5f2", "name": "network-vif-plugged", "status": "completed", "tag": "4308e410-9d50-4a55-b027-a6d836a99289"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:03.454841 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:15:03.454841 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:15:03.455955 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 589/1188] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:15:03 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:15:03.462617 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-440a1788-ef31-4bb8-9716-e0b681df131d req-7b78fb9f-45f8-4482-8c60-ee5036b80683 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:03.463007 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-440a1788-ef31-4bb8-9716-e0b681df131d req-7b78fb9f-45f8-4482-8c60-ee5036b80683 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:03.475935 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-440a1788-ef31-4bb8-9716-e0b681df131d req-7b78fb9f-45f8-4482-8c60-ee5036b80683 service nova] Creating event network-vif-plugged:4308e410-9d50-4a55-b027-a6d836a99289 for instance cde02f58-42c0-417a-94c5-7b65163fb5f2 on hv-cinder-80304 Jul 30 16:15:03.480643 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-440a1788-ef31-4bb8-9716-e0b681df131d req-7b78fb9f-45f8-4482-8c60-ee5036b80683 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031846 Jul 30 16:15:03.481476 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 600/1189] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:15:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:15:03.733129 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-619ac7b3-fdb3-4516-ba93-99190dd8feb8 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:03.733743 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-619ac7b3-fdb3-4516-ba93-99190dd8feb8 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:03.740630 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-619ac7b3-fdb3-4516-ba93-99190dd8feb8 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:03.741085 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-619ac7b3-fdb3-4516-ba93-99190dd8feb8 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:03.741859 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-619ac7b3-fdb3-4516-ba93-99190dd8feb8 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:03.742291 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-619ac7b3-fdb3-4516-ba93-99190dd8feb8 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:03.864845 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-619ac7b3-fdb3-4516-ba93-99190dd8feb8 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:03.872461 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-619ac7b3-fdb3-4516-ba93-99190dd8feb8 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1259 microversion: 2.1 time: 0.142805 Jul 30 16:15:03.873018 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 590/1190] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:03 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1259 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:15:04.227665 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-61fb3f5f-ba41-4147-815c-c9ef5411cfc3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:04.228647 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-61fb3f5f-ba41-4147-815c-c9ef5411cfc3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:04.234801 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61fb3f5f-ba41-4147-815c-c9ef5411cfc3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:04.235287 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61fb3f5f-ba41-4147-815c-c9ef5411cfc3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:04.236100 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61fb3f5f-ba41-4147-815c-c9ef5411cfc3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:04.236530 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-61fb3f5f-ba41-4147-815c-c9ef5411cfc3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:04.310622 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-61fb3f5f-ba41-4147-815c-c9ef5411cfc3 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 30862 microversion: 2.1 time: 0.086830 Jul 30 16:15:04.311286 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 601/1191] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:15:04 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 30862 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:15:04.472807 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-28b8dc9c-e041-4c75-a378-c13c81d54046 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:04.473404 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-28b8dc9c-e041-4c75-a378-c13c81d54046 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:04.479311 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-28b8dc9c-e041-4c75-a378-c13c81d54046 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:04.479698 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-28b8dc9c-e041-4c75-a378-c13c81d54046 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:04.480447 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-28b8dc9c-e041-4c75-a378-c13c81d54046 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:04.480871 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-28b8dc9c-e041-4c75-a378-c13c81d54046 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:04.598637 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-28b8dc9c-e041-4c75-a378-c13c81d54046 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:04.606205 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-28b8dc9c-e041-4c75-a378-c13c81d54046 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:04.607713 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-28b8dc9c-e041-4c75-a378-c13c81d54046 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:04.608850 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-28b8dc9c-e041-4c75-a378-c13c81d54046 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1729 microversion: 2.20 time: 0.139711 Jul 30 16:15:04.609392 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 591/1192] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:15:04 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1729 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:15:04.889850 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8f1551d3-afea-42b3-aa8c-21a5267aa1a0 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:04.890488 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8f1551d3-afea-42b3-aa8c-21a5267aa1a0 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:04.897407 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f1551d3-afea-42b3-aa8c-21a5267aa1a0 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:04.897963 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f1551d3-afea-42b3-aa8c-21a5267aa1a0 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:04.898815 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f1551d3-afea-42b3-aa8c-21a5267aa1a0 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:04.899340 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f1551d3-afea-42b3-aa8c-21a5267aa1a0 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:05.026445 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-8f1551d3-afea-42b3-aa8c-21a5267aa1a0 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:05.034165 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8f1551d3-afea-42b3-aa8c-21a5267aa1a0 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1259 microversion: 2.1 time: 0.148635 Jul 30 16:15:05.034581 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 602/1193] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:04 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:15:05.322034 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-bf182000-ae25-4594-948c-431a8208f08b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:05.322953 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-bf182000-ae25-4594-948c-431a8208f08b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:05.328875 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bf182000-ae25-4594-948c-431a8208f08b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:05.329332 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bf182000-ae25-4594-948c-431a8208f08b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:05.330109 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bf182000-ae25-4594-948c-431a8208f08b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:05.330544 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bf182000-ae25-4594-948c-431a8208f08b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:05.416094 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-bf182000-ae25-4594-948c-431a8208f08b tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 31920 microversion: 2.1 time: 0.097623 Jul 30 16:15:05.416631 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 592/1194] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:15:05 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 31920 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:15:05.626921 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3d26262f-2b1a-4b42-a9ae-a8f98f46409f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:05.627543 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3d26262f-2b1a-4b42-a9ae-a8f98f46409f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:05.633342 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3d26262f-2b1a-4b42-a9ae-a8f98f46409f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:05.633785 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3d26262f-2b1a-4b42-a9ae-a8f98f46409f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:05.634543 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3d26262f-2b1a-4b42-a9ae-a8f98f46409f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:05.634995 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3d26262f-2b1a-4b42-a9ae-a8f98f46409f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:05.751718 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-3d26262f-2b1a-4b42-a9ae-a8f98f46409f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:05.759240 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-3d26262f-2b1a-4b42-a9ae-a8f98f46409f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:05.760757 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-3d26262f-2b1a-4b42-a9ae-a8f98f46409f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:05.761893 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3d26262f-2b1a-4b42-a9ae-a8f98f46409f tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1716 microversion: 2.20 time: 0.138695 Jul 30 16:15:05.762445 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 603/1195] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:15:05 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1716 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:15:06.050411 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-67454a1d-6e28-4b75-8f34-7fc2d8ef2ed1 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:06.051019 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-67454a1d-6e28-4b75-8f34-7fc2d8ef2ed1 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:06.057444 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-67454a1d-6e28-4b75-8f34-7fc2d8ef2ed1 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:06.057885 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-67454a1d-6e28-4b75-8f34-7fc2d8ef2ed1 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:06.058637 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-67454a1d-6e28-4b75-8f34-7fc2d8ef2ed1 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:06.059068 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-67454a1d-6e28-4b75-8f34-7fc2d8ef2ed1 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:06.180147 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-67454a1d-6e28-4b75-8f34-7fc2d8ef2ed1 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:06.187975 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-67454a1d-6e28-4b75-8f34-7fc2d8ef2ed1 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1259 microversion: 2.1 time: 0.141581 Jul 30 16:15:06.188529 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 593/1196] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:06 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1259 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:15:06.428256 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-fb8c8460-839f-4629-a199-84705b0226f2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:06.429079 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-fb8c8460-839f-4629-a199-84705b0226f2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:06.435952 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fb8c8460-839f-4629-a199-84705b0226f2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:06.436393 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fb8c8460-839f-4629-a199-84705b0226f2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:06.437145 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fb8c8460-839f-4629-a199-84705b0226f2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:06.437576 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-fb8c8460-839f-4629-a199-84705b0226f2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:06.516984 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-fb8c8460-839f-4629-a199-84705b0226f2 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 32931 microversion: 2.1 time: 0.092269 Jul 30 16:15:06.517607 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 604/1197] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:15:06 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 32931 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:15:07.205059 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-577fe2fc-81c5-4004-91d7-239e802d589e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:07.205662 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-577fe2fc-81c5-4004-91d7-239e802d589e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:07.211892 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-577fe2fc-81c5-4004-91d7-239e802d589e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:07.212343 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-577fe2fc-81c5-4004-91d7-239e802d589e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:07.213107 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-577fe2fc-81c5-4004-91d7-239e802d589e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:07.213542 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-577fe2fc-81c5-4004-91d7-239e802d589e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:07.337358 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-577fe2fc-81c5-4004-91d7-239e802d589e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:07.345455 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-577fe2fc-81c5-4004-91d7-239e802d589e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1259 microversion: 2.1 time: 0.144082 Jul 30 16:15:07.346011 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 594/1198] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:07 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:15:07.531861 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3e0b8b64-68ac-479d-9933-88f47f3b1331 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:07.532787 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3e0b8b64-68ac-479d-9933-88f47f3b1331 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:07.539301 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3e0b8b64-68ac-479d-9933-88f47f3b1331 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:07.539751 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3e0b8b64-68ac-479d-9933-88f47f3b1331 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:07.540521 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3e0b8b64-68ac-479d-9933-88f47f3b1331 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:07.540957 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3e0b8b64-68ac-479d-9933-88f47f3b1331 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:07.635107 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3e0b8b64-68ac-479d-9933-88f47f3b1331 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 33556 microversion: 2.1 time: 0.109796 Jul 30 16:15:07.635780 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 605/1199] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:15:07 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 33556 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:15:08.362252 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-26dc94a1-e37b-4236-a052-9c9de664c57e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:08.362858 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-26dc94a1-e37b-4236-a052-9c9de664c57e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:08.368661 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-26dc94a1-e37b-4236-a052-9c9de664c57e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:08.369103 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-26dc94a1-e37b-4236-a052-9c9de664c57e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:08.369864 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-26dc94a1-e37b-4236-a052-9c9de664c57e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:08.370295 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-26dc94a1-e37b-4236-a052-9c9de664c57e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:08.494443 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-26dc94a1-e37b-4236-a052-9c9de664c57e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:08.502003 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-26dc94a1-e37b-4236-a052-9c9de664c57e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1259 microversion: 2.1 time: 0.143468 Jul 30 16:15:08.502562 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 595/1200] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:08 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:15:08.650432 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-9f4a70fd-bcb3-499a-a4db-ac08f59094a8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:08.651895 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-9f4a70fd-bcb3-499a-a4db-ac08f59094a8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:08.659026 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9f4a70fd-bcb3-499a-a4db-ac08f59094a8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:08.659689 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9f4a70fd-bcb3-499a-a4db-ac08f59094a8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:08.660286 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9f4a70fd-bcb3-499a-a4db-ac08f59094a8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:08.660722 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-9f4a70fd-bcb3-499a-a4db-ac08f59094a8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:08.746070 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9f4a70fd-bcb3-499a-a4db-ac08f59094a8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 34123 microversion: 2.1 time: 0.099879 Jul 30 16:15:08.746706 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 606/1201] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:15:08 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 34123 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:15:09.517670 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-10ff2565-7beb-40e4-a03e-c0559f8013ea tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:09.518458 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-10ff2565-7beb-40e4-a03e-c0559f8013ea tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:09.525167 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-10ff2565-7beb-40e4-a03e-c0559f8013ea tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:09.525623 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-10ff2565-7beb-40e4-a03e-c0559f8013ea tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:09.526403 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-10ff2565-7beb-40e4-a03e-c0559f8013ea tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:09.526839 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-10ff2565-7beb-40e4-a03e-c0559f8013ea tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:09.646043 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-10ff2565-7beb-40e4-a03e-c0559f8013ea tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:09.654274 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-10ff2565-7beb-40e4-a03e-c0559f8013ea tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1259 microversion: 2.1 time: 0.139571 Jul 30 16:15:09.654845 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 596/1202] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:09 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1259 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:15:09.758254 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0744e2c9-d6b7-49f5-bffd-11b696de3aa0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:09.759287 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0744e2c9-d6b7-49f5-bffd-11b696de3aa0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:09.766509 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0744e2c9-d6b7-49f5-bffd-11b696de3aa0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:09.766964 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0744e2c9-d6b7-49f5-bffd-11b696de3aa0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:09.767776 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0744e2c9-d6b7-49f5-bffd-11b696de3aa0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:09.768209 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0744e2c9-d6b7-49f5-bffd-11b696de3aa0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:09.866929 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0744e2c9-d6b7-49f5-bffd-11b696de3aa0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 34850 microversion: 2.1 time: 0.112450 Jul 30 16:15:09.870827 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 607/1203] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:15:09 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 34850 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:15:10.671262 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c8210cf5-6e57-4746-ad51-581bd9ea1a8f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:10.671780 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c8210cf5-6e57-4746-ad51-581bd9ea1a8f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:10.677800 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c8210cf5-6e57-4746-ad51-581bd9ea1a8f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:10.678244 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c8210cf5-6e57-4746-ad51-581bd9ea1a8f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:10.679017 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c8210cf5-6e57-4746-ad51-581bd9ea1a8f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:10.679475 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c8210cf5-6e57-4746-ad51-581bd9ea1a8f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:10.801636 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c8210cf5-6e57-4746-ad51-581bd9ea1a8f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:10.808923 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c8210cf5-6e57-4746-ad51-581bd9ea1a8f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1259 microversion: 2.1 time: 0.142627 Jul 30 16:15:10.809604 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 597/1204] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:10 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1259 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:15:10.878930 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-cb30f1b3-9281-4de5-b378-0015aba94393 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:10.879949 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-cb30f1b3-9281-4de5-b378-0015aba94393 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:10.886390 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cb30f1b3-9281-4de5-b378-0015aba94393 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:10.886837 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cb30f1b3-9281-4de5-b378-0015aba94393 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:10.888254 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cb30f1b3-9281-4de5-b378-0015aba94393 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:10.888758 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cb30f1b3-9281-4de5-b378-0015aba94393 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:10.966303 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-cb30f1b3-9281-4de5-b378-0015aba94393 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 35400 microversion: 2.1 time: 0.090643 Jul 30 16:15:10.966919 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 608/1205] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:15:10 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 35400 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:15:11.479598 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-bf2f4bbc-3124-47bf-9523-1f282d1faa41 req-4a1359f0-af04-47fa-93d6-4e10f39b2afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a", "name": "network-vif-plugged", "status": "completed", "tag": "aeca0f4b-877a-4418-be7e-80555a5d3358"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:11.481367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:15:11.481367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:15:11.488977 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-bf2f4bbc-3124-47bf-9523-1f282d1faa41 req-4a1359f0-af04-47fa-93d6-4e10f39b2afe service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:11.489472 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-bf2f4bbc-3124-47bf-9523-1f282d1faa41 req-4a1359f0-af04-47fa-93d6-4e10f39b2afe service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:11.501143 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-bf2f4bbc-3124-47bf-9523-1f282d1faa41 req-4a1359f0-af04-47fa-93d6-4e10f39b2afe service nova] Creating event network-vif-plugged:aeca0f4b-877a-4418-be7e-80555a5d3358 for instance d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a on hv-cinder-80304 Jul 30 16:15:11.505990 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-bf2f4bbc-3124-47bf-9523-1f282d1faa41 req-4a1359f0-af04-47fa-93d6-4e10f39b2afe service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030063 Jul 30 16:15:11.506612 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 598/1206] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:15:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:15:11.825957 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e9301893-4ec6-47c6-b57a-15cda276fc6e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:11.826673 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e9301893-4ec6-47c6-b57a-15cda276fc6e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:11.833119 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e9301893-4ec6-47c6-b57a-15cda276fc6e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:11.833566 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e9301893-4ec6-47c6-b57a-15cda276fc6e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:11.834339 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e9301893-4ec6-47c6-b57a-15cda276fc6e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:11.834771 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e9301893-4ec6-47c6-b57a-15cda276fc6e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:11.958506 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e9301893-4ec6-47c6-b57a-15cda276fc6e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:11.966393 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e9301893-4ec6-47c6-b57a-15cda276fc6e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1259 microversion: 2.1 time: 0.144329 Jul 30 16:15:11.966964 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 609/1207] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:11 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:15:11.978093 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ba107e44-6914-4b21-bd7c-2c989c49fee0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:11.979087 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ba107e44-6914-4b21-bd7c-2c989c49fee0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:11.985850 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ba107e44-6914-4b21-bd7c-2c989c49fee0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:11.986296 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ba107e44-6914-4b21-bd7c-2c989c49fee0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:11.987060 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ba107e44-6914-4b21-bd7c-2c989c49fee0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:11.987518 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ba107e44-6914-4b21-bd7c-2c989c49fee0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:12.063815 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ba107e44-6914-4b21-bd7c-2c989c49fee0 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 36231 microversion: 2.1 time: 0.089489 Jul 30 16:15:12.064481 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 599/1208] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:15:11 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 36231 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:15:12.983284 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d85fb5e2-7825-4997-b4c2-651d9d86ec39 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:12.983888 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d85fb5e2-7825-4997-b4c2-651d9d86ec39 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:12.990703 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d85fb5e2-7825-4997-b4c2-651d9d86ec39 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:12.991188 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d85fb5e2-7825-4997-b4c2-651d9d86ec39 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:12.992127 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d85fb5e2-7825-4997-b4c2-651d9d86ec39 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:12.992569 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d85fb5e2-7825-4997-b4c2-651d9d86ec39 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:13.076764 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-88582248-8d0c-4701-b64b-1f1ff6c3cb75 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:13.077766 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-88582248-8d0c-4701-b64b-1f1ff6c3cb75 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:13.086539 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-88582248-8d0c-4701-b64b-1f1ff6c3cb75 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:13.086995 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-88582248-8d0c-4701-b64b-1f1ff6c3cb75 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:13.088456 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-88582248-8d0c-4701-b64b-1f1ff6c3cb75 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:13.089272 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-88582248-8d0c-4701-b64b-1f1ff6c3cb75 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:13.124647 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-d85fb5e2-7825-4997-b4c2-651d9d86ec39 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:13.131975 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d85fb5e2-7825-4997-b4c2-651d9d86ec39 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1259 microversion: 2.1 time: 0.153062 Jul 30 16:15:13.132537 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 610/1209] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:12 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:15:13.186975 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-88582248-8d0c-4701-b64b-1f1ff6c3cb75 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 36835 microversion: 2.1 time: 0.114773 Jul 30 16:15:13.187648 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 600/1210] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:15:13 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 36835 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:15:14.148539 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-4bd7f948-e26f-48fb-b2ab-8b36ed7a5a90 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:14.149139 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-4bd7f948-e26f-48fb-b2ab-8b36ed7a5a90 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:14.155798 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4bd7f948-e26f-48fb-b2ab-8b36ed7a5a90 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:14.156253 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4bd7f948-e26f-48fb-b2ab-8b36ed7a5a90 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:14.157028 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4bd7f948-e26f-48fb-b2ab-8b36ed7a5a90 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:14.157470 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4bd7f948-e26f-48fb-b2ab-8b36ed7a5a90 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:14.198489 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9386be2c-8873-418e-bf6d-191cf169dbfd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:14.199507 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9386be2c-8873-418e-bf6d-191cf169dbfd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:14.206479 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9386be2c-8873-418e-bf6d-191cf169dbfd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:14.206932 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9386be2c-8873-418e-bf6d-191cf169dbfd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:14.207935 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9386be2c-8873-418e-bf6d-191cf169dbfd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:14.208375 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9386be2c-8873-418e-bf6d-191cf169dbfd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:14.275933 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-4bd7f948-e26f-48fb-b2ab-8b36ed7a5a90 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:14.284041 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-4bd7f948-e26f-48fb-b2ab-8b36ed7a5a90 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1443 microversion: 2.1 time: 0.139359 Jul 30 16:15:14.284598 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 611/1211] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:14 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1443 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:15:14.297586 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9386be2c-8873-418e-bf6d-191cf169dbfd tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 37822 microversion: 2.1 time: 0.102904 Jul 30 16:15:14.298886 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 601/1212] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:15:14 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 37822 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 16:15:14.300103 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1236e472-692e-41b1-8524-e6efb8c7c97c tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:14.300712 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1236e472-692e-41b1-8524-e6efb8c7c97c tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:14.306595 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1236e472-692e-41b1-8524-e6efb8c7c97c tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:14.307046 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1236e472-692e-41b1-8524-e6efb8c7c97c tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:14.307906 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1236e472-692e-41b1-8524-e6efb8c7c97c tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:14.308348 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1236e472-692e-41b1-8524-e6efb8c7c97c tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:14.424230 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1236e472-692e-41b1-8524-e6efb8c7c97c tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:14.431361 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1236e472-692e-41b1-8524-e6efb8c7c97c tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1443 microversion: 2.1 time: 0.134855 Jul 30 16:15:14.431913 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 612/1213] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:14 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1443 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:15:15.310694 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0d430398-da7f-46da-96ab-a67c5503d4c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:15.311783 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0d430398-da7f-46da-96ab-a67c5503d4c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:15.318185 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0d430398-da7f-46da-96ab-a67c5503d4c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:15.318622 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0d430398-da7f-46da-96ab-a67c5503d4c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:15.319455 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0d430398-da7f-46da-96ab-a67c5503d4c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:15.319902 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0d430398-da7f-46da-96ab-a67c5503d4c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:15.409700 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0d430398-da7f-46da-96ab-a67c5503d4c4 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 38168 microversion: 2.1 time: 0.103532 Jul 30 16:15:15.411369 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 602/1214] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:15:15 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 38168 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:15:16.282896 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-120a4813-b367-4897-9b59-923a945457f7 req-3e61ebdb-325b-4b03-b9cd-062e7511f3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a", "tag": "aeca0f4b-877a-4418-be7e-80555a5d3358"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:16.284394 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:15:16.284394 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:15:16.294392 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-120a4813-b367-4897-9b59-923a945457f7 req-3e61ebdb-325b-4b03-b9cd-062e7511f3a5 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:16.294605 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-120a4813-b367-4897-9b59-923a945457f7 req-3e61ebdb-325b-4b03-b9cd-062e7511f3a5 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:16.306079 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-120a4813-b367-4897-9b59-923a945457f7 req-3e61ebdb-325b-4b03-b9cd-062e7511f3a5 service nova] Creating event network-changed:aeca0f4b-877a-4418-be7e-80555a5d3358 for instance d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a on hv-cinder-80304 Jul 30 16:15:16.311751 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-120a4813-b367-4897-9b59-923a945457f7 req-3e61ebdb-325b-4b03-b9cd-062e7511f3a5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032454 Jul 30 16:15:16.312343 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 613/1215] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:15:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:15:16.422590 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8a88b5c8-47b2-4b47-9725-3639b093cc4d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:16.423789 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-8a88b5c8-47b2-4b47-9725-3639b093cc4d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:16.430236 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8a88b5c8-47b2-4b47-9725-3639b093cc4d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:16.430679 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8a88b5c8-47b2-4b47-9725-3639b093cc4d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:16.431476 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8a88b5c8-47b2-4b47-9725-3639b093cc4d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:16.431899 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8a88b5c8-47b2-4b47-9725-3639b093cc4d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:16.511988 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8a88b5c8-47b2-4b47-9725-3639b093cc4d tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 38168 microversion: 2.1 time: 0.093819 Jul 30 16:15:16.512704 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 603/1216] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:15:16 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 38168 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:15:17.524748 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-7653a989-415a-483f-95c5-4c9af7a2927a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:17.525772 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7653a989-415a-483f-95c5-4c9af7a2927a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:17.532366 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7653a989-415a-483f-95c5-4c9af7a2927a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:17.532813 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7653a989-415a-483f-95c5-4c9af7a2927a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:17.533596 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7653a989-415a-483f-95c5-4c9af7a2927a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:17.534011 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7653a989-415a-483f-95c5-4c9af7a2927a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:17.607965 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-7653a989-415a-483f-95c5-4c9af7a2927a tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action" status: 200 len: 38297 microversion: 2.1 time: 0.087210 Jul 30 16:15:17.613198 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 614/1217] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:15:17 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/action => generated 38297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 16:15:17.618689 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-763b66bb-578b-4156-8322-9159833edbf9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:17.619342 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-763b66bb-578b-4156-8322-9159833edbf9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:17.626097 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-763b66bb-578b-4156-8322-9159833edbf9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:17.626552 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-763b66bb-578b-4156-8322-9159833edbf9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:17.627355 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-763b66bb-578b-4156-8322-9159833edbf9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:17.627794 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-763b66bb-578b-4156-8322-9159833edbf9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:17.651600 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-763b66bb-578b-4156-8322-9159833edbf9 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/ips" status: 200 len: 145 microversion: 2.1 time: 0.036798 Jul 30 16:15:17.652169 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 604/1218] 10.222.0.37 () {58 vars in 1248 bytes} [Fri Jul 30 16:15:17 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:15:18.962867 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-977033c4-a0d3-4723-b804-f370a3433f11 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bc5ed98-4636-4d23-8b14-74906d4adf02"}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:18.964005 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-977033c4-a0d3-4723-b804-f370a3433f11 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:18.970291 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-977033c4-a0d3-4723-b804-f370a3433f11 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:18.970727 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-977033c4-a0d3-4723-b804-f370a3433f11 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:18.971503 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-977033c4-a0d3-4723-b804-f370a3433f11 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:18.971963 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-977033c4-a0d3-4723-b804-f370a3433f11 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:19.204052 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-977033c4-a0d3-4723-b804-f370a3433f11 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245187 Jul 30 16:15:19.204644 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 615/1219] 10.222.0.37 () {60 vars in 1323 bytes} [Fri Jul 30 16:15:18 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:15:26.653216 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9eb7521e-c41a-4711-91ae-98edb44b6c55 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:26.654129 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9eb7521e-c41a-4711-91ae-98edb44b6c55 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:26.661151 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9eb7521e-c41a-4711-91ae-98edb44b6c55 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:26.661597 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9eb7521e-c41a-4711-91ae-98edb44b6c55 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:26.662374 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9eb7521e-c41a-4711-91ae-98edb44b6c55 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:26.662810 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9eb7521e-c41a-4711-91ae-98edb44b6c55 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:26.692202 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9eb7521e-c41a-4711-91ae-98edb44b6c55 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042746 Jul 30 16:15:26.692753 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 605/1220] 10.222.0.37 () {58 vars in 1302 bytes} [Fri Jul 30 16:15:26 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:15:26.705349 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-bb833528-8656-4965-9d52-cfae9c9f7bc6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:26.705910 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-bb833528-8656-4965-9d52-cfae9c9f7bc6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:26.711920 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bb833528-8656-4965-9d52-cfae9c9f7bc6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:26.712363 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bb833528-8656-4965-9d52-cfae9c9f7bc6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:26.713112 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bb833528-8656-4965-9d52-cfae9c9f7bc6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:26.713535 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bb833528-8656-4965-9d52-cfae9c9f7bc6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:26.742106 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-bb833528-8656-4965-9d52-cfae9c9f7bc6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-volume_attachments/2bc5ed98-4636-4d23-8b14-74906d4adf02" status: 200 len: 194 microversion: 2.1 time: 0.042312 Jul 30 16:15:26.742669 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 616/1221] 10.222.0.37 () {58 vars in 1413 bytes} [Fri Jul 30 16:15:26 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-volume_attachments/2bc5ed98-4636-4d23-8b14-74906d4adf02 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:15:28.060785 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4c8e670d-581e-4a62-9bde-7d1d90b43be8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edb9715f-4389-4f05-aa76-ffefea80ddba"}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:28.061822 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4c8e670d-581e-4a62-9bde-7d1d90b43be8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:28.068922 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4c8e670d-581e-4a62-9bde-7d1d90b43be8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:28.069372 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4c8e670d-581e-4a62-9bde-7d1d90b43be8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:28.070172 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4c8e670d-581e-4a62-9bde-7d1d90b43be8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:28.070605 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4c8e670d-581e-4a62-9bde-7d1d90b43be8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:28.301445 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4c8e670d-581e-4a62-9bde-7d1d90b43be8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.244065 Jul 30 16:15:28.302087 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 606/1222] 10.222.0.37 () {60 vars in 1323 bytes} [Fri Jul 30 16:15:28 2021] POST /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-volume_attachments => generated 194 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:15:35.750931 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-d45bd82b-0d91-484b-a983-24a6f5016c28 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:35.751920 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-d45bd82b-0d91-484b-a983-24a6f5016c28 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:35.758119 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d45bd82b-0d91-484b-a983-24a6f5016c28 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:35.758561 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d45bd82b-0d91-484b-a983-24a6f5016c28 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:35.759352 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d45bd82b-0d91-484b-a983-24a6f5016c28 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:35.759780 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-d45bd82b-0d91-484b-a983-24a6f5016c28 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:35.789642 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-d45bd82b-0d91-484b-a983-24a6f5016c28 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042488 Jul 30 16:15:35.790191 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 617/1223] 10.222.0.37 () {58 vars in 1302 bytes} [Fri Jul 30 16:15:35 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:15:36.036649 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-6053c91c-4470-4351-b5f8-9d3a98beb55c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:36.037213 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-6053c91c-4470-4351-b5f8-9d3a98beb55c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:36.043756 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6053c91c-4470-4351-b5f8-9d3a98beb55c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:36.044202 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6053c91c-4470-4351-b5f8-9d3a98beb55c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:36.044970 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6053c91c-4470-4351-b5f8-9d3a98beb55c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:36.045403 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6053c91c-4470-4351-b5f8-9d3a98beb55c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:36.074905 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-6053c91c-4470-4351-b5f8-9d3a98beb55c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-volume_attachments/2bc5ed98-4636-4d23-8b14-74906d4adf02" status: 200 len: 194 microversion: 2.1 time: 0.042335 Jul 30 16:15:36.075501 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 607/1224] 10.222.0.37 () {58 vars in 1413 bytes} [Fri Jul 30 16:15:36 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-volume_attachments/2bc5ed98-4636-4d23-8b14-74906d4adf02 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:15:36.085372 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8f82b221-6160-4962-b6e2-39aee2c6173c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:36.085856 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8f82b221-6160-4962-b6e2-39aee2c6173c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:36.091578 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f82b221-6160-4962-b6e2-39aee2c6173c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:36.092020 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f82b221-6160-4962-b6e2-39aee2c6173c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:36.092774 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f82b221-6160-4962-b6e2-39aee2c6173c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:36.093202 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8f82b221-6160-4962-b6e2-39aee2c6173c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:36.173771 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.objects.instance [None req-8f82b221-6160-4962-b6e2-39aee2c6173c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lazy-loading 'services' on Instance uuid 73763b31-8f9b-4de3-869a-0e9dc418231f {{(pid=107452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:15:36.235626 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8f82b221-6160-4962-b6e2-39aee2c6173c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "DELETE /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-volume_attachments/2bc5ed98-4636-4d23-8b14-74906d4adf02" status: 202 len: 0 microversion: 2.1 time: 0.153787 Jul 30 16:15:36.236221 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 618/1225] 10.222.0.37 () {58 vars in 1416 bytes} [Fri Jul 30 16:15:36 2021] DELETE /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-volume_attachments/2bc5ed98-4636-4d23-8b14-74906d4adf02 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:15:38.409287 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b53ed596-3ec3-470e-8149-93970131d157 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:38.409770 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b53ed596-3ec3-470e-8149-93970131d157 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:38.415866 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b53ed596-3ec3-470e-8149-93970131d157 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:38.416311 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b53ed596-3ec3-470e-8149-93970131d157 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:38.417068 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b53ed596-3ec3-470e-8149-93970131d157 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:38.417495 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b53ed596-3ec3-470e-8149-93970131d157 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:38.451291 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b53ed596-3ec3-470e-8149-93970131d157 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-volume_attachments/edb9715f-4389-4f05-aa76-ffefea80ddba" status: 200 len: 194 microversion: 2.1 time: 0.046196 Jul 30 16:15:38.451902 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 608/1226] 10.222.0.37 () {58 vars in 1413 bytes} [Fri Jul 30 16:15:38 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-volume_attachments/edb9715f-4389-4f05-aa76-ffefea80ddba => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:15:38.462262 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-faa6cb2d-2034-444c-b838-3694d4f3003c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:38.462899 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-faa6cb2d-2034-444c-b838-3694d4f3003c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:38.470712 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-faa6cb2d-2034-444c-b838-3694d4f3003c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:38.471199 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-faa6cb2d-2034-444c-b838-3694d4f3003c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:38.471970 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-faa6cb2d-2034-444c-b838-3694d4f3003c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:38.472404 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-faa6cb2d-2034-444c-b838-3694d4f3003c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:38.555276 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.objects.instance [None req-faa6cb2d-2034-444c-b838-3694d4f3003c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lazy-loading 'services' on Instance uuid 73763b31-8f9b-4de3-869a-0e9dc418231f {{(pid=107452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:15:38.617950 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-faa6cb2d-2034-444c-b838-3694d4f3003c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "DELETE /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-volume_attachments/edb9715f-4389-4f05-aa76-ffefea80ddba" status: 202 len: 0 microversion: 2.1 time: 0.159686 Jul 30 16:15:38.618866 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 619/1227] 10.222.0.37 () {58 vars in 1416 bytes} [Fri Jul 30 16:15:38 2021] DELETE /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f/os-volume_attachments/edb9715f-4389-4f05-aa76-ffefea80ddba => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:15:39.930442 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-fe5693f6-91c0-465c-94f9-454fe10f33e8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:39.930994 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-fe5693f6-91c0-465c-94f9-454fe10f33e8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:39.936746 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fe5693f6-91c0-465c-94f9-454fe10f33e8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:39.937127 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fe5693f6-91c0-465c-94f9-454fe10f33e8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:39.937888 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fe5693f6-91c0-465c-94f9-454fe10f33e8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:39.938315 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fe5693f6-91c0-465c-94f9-454fe10f33e8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:39.961913 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-fe5693f6-91c0-465c-94f9-454fe10f33e8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Going to try to terminate instance {{(pid=107453) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:15:40.034355 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-fe5693f6-91c0-465c-94f9-454fe10f33e8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "DELETE /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f" status: 204 len: 0 microversion: 2.1 time: 0.107284 Jul 30 16:15:40.035033 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 609/1228] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:15:39 2021] DELETE /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 16:15:40.044413 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3bdbdeec-0136-4c26-994d-4485514a0cb6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:40.045866 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3bdbdeec-0136-4c26-994d-4485514a0cb6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:40.052411 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3bdbdeec-0136-4c26-994d-4485514a0cb6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:40.052870 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3bdbdeec-0136-4c26-994d-4485514a0cb6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:40.053655 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3bdbdeec-0136-4c26-994d-4485514a0cb6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:40.054094 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3bdbdeec-0136-4c26-994d-4485514a0cb6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:40.175837 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-3bdbdeec-0136-4c26-994d-4485514a0cb6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:40.183044 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3bdbdeec-0136-4c26-994d-4485514a0cb6 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f" status: 200 len: 1672 microversion: 2.1 time: 0.143601 Jul 30 16:15:40.183669 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 620/1229] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:40 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f => generated 1672 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:15:41.200869 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1fb5d9f1-687e-46dc-abd5-265703223f53 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:41.201570 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1fb5d9f1-687e-46dc-abd5-265703223f53 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:41.207905 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1fb5d9f1-687e-46dc-abd5-265703223f53 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:41.208363 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1fb5d9f1-687e-46dc-abd5-265703223f53 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:41.209104 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1fb5d9f1-687e-46dc-abd5-265703223f53 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:41.209530 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1fb5d9f1-687e-46dc-abd5-265703223f53 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:41.334161 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1fb5d9f1-687e-46dc-abd5-265703223f53 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:41.341604 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1fb5d9f1-687e-46dc-abd5-265703223f53 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f" status: 200 len: 1672 microversion: 2.1 time: 0.144769 Jul 30 16:15:41.342161 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 610/1230] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:41 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f => generated 1672 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:15:42.358880 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-20888c2f-0a08-4d26-a576-11f5989a981c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:42.361546 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-20888c2f-0a08-4d26-a576-11f5989a981c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:42.368593 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-20888c2f-0a08-4d26-a576-11f5989a981c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:42.369047 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-20888c2f-0a08-4d26-a576-11f5989a981c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:42.369821 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-20888c2f-0a08-4d26-a576-11f5989a981c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:42.370271 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-20888c2f-0a08-4d26-a576-11f5989a981c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:42.493254 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-20888c2f-0a08-4d26-a576-11f5989a981c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:42.500594 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-20888c2f-0a08-4d26-a576-11f5989a981c tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f" status: 200 len: 1672 microversion: 2.1 time: 0.145311 Jul 30 16:15:42.501755 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 621/1231] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:42 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f => generated 1672 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:15:43.429758 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-3ae045ef-1ec6-4d48-9440-de272bbfd23b req-149fd78d-4f9b-4f70-95b6-16cb9407a890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73763b31-8f9b-4de3-869a-0e9dc418231f", "name": "network-vif-deleted", "tag": "85ee21b6-2ddd-43b1-b8f4-2677b088a5b8"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:43.431641 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:15:43.431641 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:15:43.450498 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-3ae045ef-1ec6-4d48-9440-de272bbfd23b req-149fd78d-4f9b-4f70-95b6-16cb9407a890 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:43.450947 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-3ae045ef-1ec6-4d48-9440-de272bbfd23b req-149fd78d-4f9b-4f70-95b6-16cb9407a890 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:43.470552 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-3ae045ef-1ec6-4d48-9440-de272bbfd23b req-149fd78d-4f9b-4f70-95b6-16cb9407a890 service nova] Creating event network-vif-deleted:85ee21b6-2ddd-43b1-b8f4-2677b088a5b8 for instance 73763b31-8f9b-4de3-869a-0e9dc418231f on hv-cinder-80304 Jul 30 16:15:43.481998 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-3ae045ef-1ec6-4d48-9440-de272bbfd23b req-149fd78d-4f9b-4f70-95b6-16cb9407a890 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055652 Jul 30 16:15:43.483252 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 611/1232] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:15:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:15:43.522637 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a5a3f270-ea0a-4653-a6c6-31de8c773e9e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:43.524338 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a5a3f270-ea0a-4653-a6c6-31de8c773e9e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:43.531733 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a5a3f270-ea0a-4653-a6c6-31de8c773e9e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:43.532563 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a5a3f270-ea0a-4653-a6c6-31de8c773e9e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:43.533551 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a5a3f270-ea0a-4653-a6c6-31de8c773e9e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:43.534215 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a5a3f270-ea0a-4653-a6c6-31de8c773e9e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:43.578829 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a5a3f270-ea0a-4653-a6c6-31de8c773e9e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:43.580117 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a5a3f270-ea0a-4653-a6c6-31de8c773e9e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:43.580815 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.objects.instance [None req-a5a3f270-ea0a-4653-a6c6-31de8c773e9e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lazy-loading 'fault' on Instance uuid 73763b31-8f9b-4de3-869a-0e9dc418231f {{(pid=107452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:15:43.629550 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-a5a3f270-ea0a-4653-a6c6-31de8c773e9e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab02c2f0aba54c22b96721d792ae4a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bd283ed91a45de8865533d41ffec34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:43.639589 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a5a3f270-ea0a-4653-a6c6-31de8c773e9e tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f" status: 200 len: 1326 microversion: 2.1 time: 0.125040 Jul 30 16:15:43.643188 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 622/1233] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:43 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f => generated 1326 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:15:44.658783 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-59566d46-dd75-497a-bf9d-411373e2b696 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:44.659436 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-59566d46-dd75-497a-bf9d-411373e2b696 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:44.665484 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-59566d46-dd75-497a-bf9d-411373e2b696 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:44.665931 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-59566d46-dd75-497a-bf9d-411373e2b696 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:44.666702 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-59566d46-dd75-497a-bf9d-411373e2b696 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:44.667156 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-59566d46-dd75-497a-bf9d-411373e2b696 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:44.680735 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-59566d46-dd75-497a-bf9d-411373e2b696 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] HTTP exception thrown: Instance 73763b31-8f9b-4de3-869a-0e9dc418231f could not be found. Jul 30 16:15:44.681324 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-59566d46-dd75-497a-bf9d-411373e2b696 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Returning 404 to user: Instance 73763b31-8f9b-4de3-869a-0e9dc418231f could not be found. {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:15:44.682137 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-59566d46-dd75-497a-bf9d-411373e2b696 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f" status: 404 len: 111 microversion: 2.1 time: 0.028188 Jul 30 16:15:44.682650 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 612/1234] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:44 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:15:44.691609 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-695800e5-0b69-4365-903e-eed94af314be tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '.version_select at 0x7fb17ea53700>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:44.709788 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-695800e5-0b69-4365-903e-eed94af314be tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-396818474" status: 202 len: 0 microversion: 2.1 time: 0.022559 Jul 30 16:15:44.710347 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 623/1235] 10.222.0.37 () {58 vars in 1218 bytes} [Fri Jul 30 16:15:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-396818474 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:15:47.569882 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f5007021-2735-4184-9318-bf2596201912 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:47.570378 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f5007021-2735-4184-9318-bf2596201912 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:47.576088 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f5007021-2735-4184-9318-bf2596201912 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:47.576544 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f5007021-2735-4184-9318-bf2596201912 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:47.577307 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f5007021-2735-4184-9318-bf2596201912 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:47.577738 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f5007021-2735-4184-9318-bf2596201912 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:47.591155 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-f5007021-2735-4184-9318-bf2596201912 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] HTTP exception thrown: Instance 73763b31-8f9b-4de3-869a-0e9dc418231f could not be found. Jul 30 16:15:47.591741 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f5007021-2735-4184-9318-bf2596201912 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Returning 404 to user: Instance 73763b31-8f9b-4de3-869a-0e9dc418231f could not be found. {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:15:47.592537 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f5007021-2735-4184-9318-bf2596201912 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "DELETE /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f" status: 404 len: 111 microversion: 2.1 time: 0.026339 Jul 30 16:15:47.593036 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 613/1236] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:15:47 2021] DELETE /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:15:47.601339 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f8d5ab33-6acc-4092-ae4c-ba0c1596cb30 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:47.601942 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f8d5ab33-6acc-4092-ae4c-ba0c1596cb30 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: 73763b31-8f9b-4de3-869a-0e9dc418231f] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:47.607636 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f8d5ab33-6acc-4092-ae4c-ba0c1596cb30 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:47.608081 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f8d5ab33-6acc-4092-ae4c-ba0c1596cb30 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:47.608837 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f8d5ab33-6acc-4092-ae4c-ba0c1596cb30 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:47.609263 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f8d5ab33-6acc-4092-ae4c-ba0c1596cb30 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:47.622393 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-f8d5ab33-6acc-4092-ae4c-ba0c1596cb30 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] HTTP exception thrown: Instance 73763b31-8f9b-4de3-869a-0e9dc418231f could not be found. Jul 30 16:15:47.622915 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f8d5ab33-6acc-4092-ae4c-ba0c1596cb30 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Returning 404 to user: Instance 73763b31-8f9b-4de3-869a-0e9dc418231f could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:15:47.623741 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f8d5ab33-6acc-4092-ae4c-ba0c1596cb30 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f" status: 404 len: 111 microversion: 2.1 time: 0.026120 Jul 30 16:15:47.624250 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 624/1237] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:47 2021] GET /compute/v2.1/servers/73763b31-8f9b-4de3-869a-0e9dc418231f => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:15:48.007757 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a7aa8080-ba91-46ef-a546-054805c8a135 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:48.008303 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a7aa8080-ba91-46ef-a546-054805c8a135 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:48.014061 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a7aa8080-ba91-46ef-a546-054805c8a135 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:48.014513 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a7aa8080-ba91-46ef-a546-054805c8a135 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:48.015316 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a7aa8080-ba91-46ef-a546-054805c8a135 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:48.015754 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a7aa8080-ba91-46ef-a546-054805c8a135 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:48.040291 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a7aa8080-ba91-46ef-a546-054805c8a135 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Going to try to terminate instance {{(pid=107453) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:15:48.113880 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a7aa8080-ba91-46ef-a546-054805c8a135 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "DELETE /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 204 len: 0 microversion: 2.20 time: 0.109594 Jul 30 16:15:48.114461 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 614/1238] 10.222.0.37 () {60 vars in 1280 bytes} [Fri Jul 30 16:15:48 2021] DELETE /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 16:15:48.123416 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-80bcd650-7343-4fbb-b1ae-fa16b1829a15 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:48.124235 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-80bcd650-7343-4fbb-b1ae-fa16b1829a15 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:48.131604 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-80bcd650-7343-4fbb-b1ae-fa16b1829a15 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:48.132125 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-80bcd650-7343-4fbb-b1ae-fa16b1829a15 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:48.133043 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-80bcd650-7343-4fbb-b1ae-fa16b1829a15 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:48.133505 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-80bcd650-7343-4fbb-b1ae-fa16b1829a15 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:48.276143 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-80bcd650-7343-4fbb-b1ae-fa16b1829a15 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:48.284950 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-80bcd650-7343-4fbb-b1ae-fa16b1829a15 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:48.286486 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-80bcd650-7343-4fbb-b1ae-fa16b1829a15 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:48.287665 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-80bcd650-7343-4fbb-b1ae-fa16b1829a15 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1722 microversion: 2.20 time: 0.168732 Jul 30 16:15:48.288454 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 625/1239] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:15:48 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 16:15:48.757658 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-de7c46cf-6241-4801-9f48-93a51e7fbdf8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:48.758281 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-de7c46cf-6241-4801-9f48-93a51e7fbdf8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:48.764633 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-de7c46cf-6241-4801-9f48-93a51e7fbdf8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:48.765079 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-de7c46cf-6241-4801-9f48-93a51e7fbdf8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:48.765919 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-de7c46cf-6241-4801-9f48-93a51e7fbdf8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:48.769503 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-de7c46cf-6241-4801-9f48-93a51e7fbdf8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:48.786212 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-de7c46cf-6241-4801-9f48-93a51e7fbdf8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] HTTP exception thrown: Instance dbd5216c-577d-42c9-a471-a99a85090a20 could not be found. Jul 30 16:15:48.786976 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-de7c46cf-6241-4801-9f48-93a51e7fbdf8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Returning 404 to user: Instance dbd5216c-577d-42c9-a471-a99a85090a20 could not be found. {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:15:48.788048 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-de7c46cf-6241-4801-9f48-93a51e7fbdf8 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "DELETE /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 404 len: 111 microversion: 2.1 time: 0.034575 Jul 30 16:15:48.788728 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 615/1240] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:15:48 2021] DELETE /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:15:48.797225 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f3b4eeb4-a1f7-4892-85cc-d09190755074 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:48.797906 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f3b4eeb4-a1f7-4892-85cc-d09190755074 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] [instance: dbd5216c-577d-42c9-a471-a99a85090a20] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:48.804000 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f3b4eeb4-a1f7-4892-85cc-d09190755074 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:48.804442 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f3b4eeb4-a1f7-4892-85cc-d09190755074 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:48.805232 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f3b4eeb4-a1f7-4892-85cc-d09190755074 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:48.805663 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f3b4eeb4-a1f7-4892-85cc-d09190755074 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:48.819008 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-f3b4eeb4-a1f7-4892-85cc-d09190755074 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] HTTP exception thrown: Instance dbd5216c-577d-42c9-a471-a99a85090a20 could not be found. Jul 30 16:15:48.819612 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f3b4eeb4-a1f7-4892-85cc-d09190755074 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] Returning 404 to user: Instance dbd5216c-577d-42c9-a471-a99a85090a20 could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:15:48.820414 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f3b4eeb4-a1f7-4892-85cc-d09190755074 tempest-AttachVolumeTestJSON-947535243 tempest-AttachVolumeTestJSON-947535243-project] 10.222.0.37 "GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20" status: 404 len: 111 microversion: 2.1 time: 0.027194 Jul 30 16:15:48.820925 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 626/1241] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:48 2021] GET /compute/v2.1/servers/dbd5216c-577d-42c9-a471-a99a85090a20 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:15:49.306621 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f28b86f0-8e5f-4acf-8c5c-1114ef9b0cb4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:49.307269 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f28b86f0-8e5f-4acf-8c5c-1114ef9b0cb4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:49.312986 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f28b86f0-8e5f-4acf-8c5c-1114ef9b0cb4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:49.314116 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f28b86f0-8e5f-4acf-8c5c-1114ef9b0cb4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:49.315073 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f28b86f0-8e5f-4acf-8c5c-1114ef9b0cb4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:49.315537 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f28b86f0-8e5f-4acf-8c5c-1114ef9b0cb4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:49.515278 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f28b86f0-8e5f-4acf-8c5c-1114ef9b0cb4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:49.523355 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f28b86f0-8e5f-4acf-8c5c-1114ef9b0cb4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:49.524779 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f28b86f0-8e5f-4acf-8c5c-1114ef9b0cb4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:49.525908 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f28b86f0-8e5f-4acf-8c5c-1114ef9b0cb4 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1722 microversion: 2.20 time: 0.223394 Jul 30 16:15:49.526448 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 616/1242] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:15:49 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:15:50.544513 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-7a887e9c-3df8-4397-a19b-66bf6a71b7f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:50.545053 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7a887e9c-3df8-4397-a19b-66bf6a71b7f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:50.552126 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7a887e9c-3df8-4397-a19b-66bf6a71b7f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:50.552581 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7a887e9c-3df8-4397-a19b-66bf6a71b7f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:50.553363 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7a887e9c-3df8-4397-a19b-66bf6a71b7f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:50.553801 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7a887e9c-3df8-4397-a19b-66bf6a71b7f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:50.675063 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-7a887e9c-3df8-4397-a19b-66bf6a71b7f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:50.682836 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-7a887e9c-3df8-4397-a19b-66bf6a71b7f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:50.684375 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-7a887e9c-3df8-4397-a19b-66bf6a71b7f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:50.685512 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-7a887e9c-3df8-4397-a19b-66bf6a71b7f5 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1722 microversion: 2.20 time: 0.144861 Jul 30 16:15:50.686066 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 627/1243] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:15:50 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:15:51.705633 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-eeb24d07-6fd5-43da-9a3b-104c496d0611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:51.707160 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-eeb24d07-6fd5-43da-9a3b-104c496d0611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:51.715687 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-eeb24d07-6fd5-43da-9a3b-104c496d0611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:51.716418 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-eeb24d07-6fd5-43da-9a3b-104c496d0611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:51.717260 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-eeb24d07-6fd5-43da-9a3b-104c496d0611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:51.718106 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-eeb24d07-6fd5-43da-9a3b-104c496d0611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:51.725237 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-5a89077b-c8ce-4216-aec8-4e4d24f4cd36 req-b57e7b8a-79f7-4974-b6b2-664514dbe1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde02f58-42c0-417a-94c5-7b65163fb5f2", "name": "network-vif-deleted", "tag": "4308e410-9d50-4a55-b027-a6d836a99289"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:15:51.727574 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:15:51.727574 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:15:51.735373 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-5a89077b-c8ce-4216-aec8-4e4d24f4cd36 req-b57e7b8a-79f7-4974-b6b2-664514dbe1b7 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:51.736223 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-5a89077b-c8ce-4216-aec8-4e4d24f4cd36 req-b57e7b8a-79f7-4974-b6b2-664514dbe1b7 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:51.766193 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-5a89077b-c8ce-4216-aec8-4e4d24f4cd36 req-b57e7b8a-79f7-4974-b6b2-664514dbe1b7 service nova] Creating event network-vif-deleted:4308e410-9d50-4a55-b027-a6d836a99289 for instance cde02f58-42c0-417a-94c5-7b65163fb5f2 on hv-cinder-80304 Jul 30 16:15:51.775720 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-5a89077b-c8ce-4216-aec8-4e4d24f4cd36 req-b57e7b8a-79f7-4974-b6b2-664514dbe1b7 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052896 Jul 30 16:15:51.776736 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 628/1244] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:15:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:15:51.845072 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-eeb24d07-6fd5-43da-9a3b-104c496d0611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:51.855618 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-eeb24d07-6fd5-43da-9a3b-104c496d0611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:51.857131 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-eeb24d07-6fd5-43da-9a3b-104c496d0611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aaf97d73fdd480bb6b5affcd2bdcfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18470f178d164e4a822da596125f2a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:15:51.858722 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-eeb24d07-6fd5-43da-9a3b-104c496d0611 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 200 len: 1655 microversion: 2.20 time: 0.157787 Jul 30 16:15:51.859809 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 617/1245] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:15:51 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 1655 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 16:15:52.879069 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3f111b60-f1dd-4399-a818-8e6245f1feef tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:52.879929 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3f111b60-f1dd-4399-a818-8e6245f1feef tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:52.886704 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3f111b60-f1dd-4399-a818-8e6245f1feef tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:52.887277 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3f111b60-f1dd-4399-a818-8e6245f1feef tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:52.888121 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3f111b60-f1dd-4399-a818-8e6245f1feef tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:52.888633 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3f111b60-f1dd-4399-a818-8e6245f1feef tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:52.905760 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-3f111b60-f1dd-4399-a818-8e6245f1feef tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] HTTP exception thrown: Instance cde02f58-42c0-417a-94c5-7b65163fb5f2 could not be found. Jul 30 16:15:52.905760 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3f111b60-f1dd-4399-a818-8e6245f1feef tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Returning 404 to user: Instance cde02f58-42c0-417a-94c5-7b65163fb5f2 could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:15:52.906346 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3f111b60-f1dd-4399-a818-8e6245f1feef tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 404 len: 111 microversion: 2.20 time: 0.032149 Jul 30 16:15:52.910595 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 629/1246] 10.222.0.37 () {60 vars in 1277 bytes} [Fri Jul 30 16:15:52 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 16:15:52.915569 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8ab75085-87b2-4252-b60b-86bfa36f3036 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '.version_select at 0x7fb17e8f2ca0>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:52.935123 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8ab75085-87b2-4252-b60b-86bfa36f3036 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-142575181" status: 204 len: 0 microversion: 2.20 time: 0.023168 Jul 30 16:15:52.936168 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 618/1247] 10.222.0.37 () {60 vars in 1259 bytes} [Fri Jul 30 16:15:52 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-142575181 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 16:15:55.034145 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ca63df81-e5af-458b-aa82-f756c6350e1c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:55.034664 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ca63df81-e5af-458b-aa82-f756c6350e1c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:55.040485 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ca63df81-e5af-458b-aa82-f756c6350e1c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:55.040933 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ca63df81-e5af-458b-aa82-f756c6350e1c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:55.041707 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ca63df81-e5af-458b-aa82-f756c6350e1c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:55.042142 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ca63df81-e5af-458b-aa82-f756c6350e1c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:55.055641 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-ca63df81-e5af-458b-aa82-f756c6350e1c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] HTTP exception thrown: Instance cde02f58-42c0-417a-94c5-7b65163fb5f2 could not be found. Jul 30 16:15:55.056228 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ca63df81-e5af-458b-aa82-f756c6350e1c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Returning 404 to user: Instance cde02f58-42c0-417a-94c5-7b65163fb5f2 could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:15:55.057049 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ca63df81-e5af-458b-aa82-f756c6350e1c tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "DELETE /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 404 len: 111 microversion: 2.1 time: 0.026696 Jul 30 16:15:55.057576 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 630/1248] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:15:55 2021] DELETE /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:15:55.066654 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b3d88e45-2bbf-498f-926e-1ee9ec8d42f9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:55.067778 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b3d88e45-2bbf-498f-926e-1ee9ec8d42f9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: cde02f58-42c0-417a-94c5-7b65163fb5f2] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:55.074664 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b3d88e45-2bbf-498f-926e-1ee9ec8d42f9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:55.075121 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b3d88e45-2bbf-498f-926e-1ee9ec8d42f9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:55.075932 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b3d88e45-2bbf-498f-926e-1ee9ec8d42f9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:55.076367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b3d88e45-2bbf-498f-926e-1ee9ec8d42f9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:55.090000 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-b3d88e45-2bbf-498f-926e-1ee9ec8d42f9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] HTTP exception thrown: Instance cde02f58-42c0-417a-94c5-7b65163fb5f2 could not be found. Jul 30 16:15:55.090637 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b3d88e45-2bbf-498f-926e-1ee9ec8d42f9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Returning 404 to user: Instance cde02f58-42c0-417a-94c5-7b65163fb5f2 could not be found. {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:15:55.091508 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b3d88e45-2bbf-498f-926e-1ee9ec8d42f9 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2" status: 404 len: 111 microversion: 2.1 time: 0.029759 Jul 30 16:15:55.092046 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 619/1249] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:55 2021] GET /compute/v2.1/servers/cde02f58-42c0-417a-94c5-7b65163fb5f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:15:56.227889 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-7f422b34-6ef5-4551-a110-34bb41d8751a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:56.228386 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7f422b34-6ef5-4551-a110-34bb41d8751a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:56.234075 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7f422b34-6ef5-4551-a110-34bb41d8751a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:56.234525 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7f422b34-6ef5-4551-a110-34bb41d8751a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:56.235343 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7f422b34-6ef5-4551-a110-34bb41d8751a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:56.235775 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7f422b34-6ef5-4551-a110-34bb41d8751a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:56.249106 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-7f422b34-6ef5-4551-a110-34bb41d8751a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] HTTP exception thrown: Instance ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb could not be found. Jul 30 16:15:56.249694 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-7f422b34-6ef5-4551-a110-34bb41d8751a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Returning 404 to user: Instance ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:15:56.250515 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-7f422b34-6ef5-4551-a110-34bb41d8751a tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "DELETE /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 404 len: 111 microversion: 2.1 time: 0.026383 Jul 30 16:15:56.251047 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 631/1250] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:15:56 2021] DELETE /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:15:56.260068 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-56192005-d5b6-4f6c-b20d-e05f6a03b729 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:15:56.261045 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-56192005-d5b6-4f6c-b20d-e05f6a03b729 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] [instance: ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:15:56.267073 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56192005-d5b6-4f6c-b20d-e05f6a03b729 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:56.267602 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56192005-d5b6-4f6c-b20d-e05f6a03b729 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:56.269079 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56192005-d5b6-4f6c-b20d-e05f6a03b729 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:15:56.269513 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-56192005-d5b6-4f6c-b20d-e05f6a03b729 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:15:56.284790 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-56192005-d5b6-4f6c-b20d-e05f6a03b729 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] HTTP exception thrown: Instance ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb could not be found. Jul 30 16:15:56.285321 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-56192005-d5b6-4f6c-b20d-e05f6a03b729 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] Returning 404 to user: Instance ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb could not be found. {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:15:56.286128 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-56192005-d5b6-4f6c-b20d-e05f6a03b729 tempest-AttachVolumeShelveTestJSON-1448310300 tempest-AttachVolumeShelveTestJSON-1448310300-project] 10.222.0.37 "GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb" status: 404 len: 111 microversion: 2.1 time: 0.029769 Jul 30 16:15:56.286649 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 620/1251] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:15:56 2021] GET /compute/v2.1/servers/ecf6cb1e-4adb-4ce3-9c64-88b868ad3beb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:16:00.573306 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f765f60f-13a0-412a-b1b3-5369348364b8 tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] Action: 'create', calling method: .version_select at 0x7fb17ea5a280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1151975314", "metadata": {"Type": "work"}}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:16:00.574777 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f765f60f-13a0-412a-b1b3-5369348364b8 tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:16:00.575613 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f765f60f-13a0-412a-b1b3-5369348364b8 tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.110919 Jul 30 16:16:00.576136 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 632/1252] 10.222.0.37 () {60 vars in 1156 bytes} [Fri Jul 30 16:16:00 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 16:16:00.586118 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f3662076-567d-45ed-a575-b355844733cf tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] Action: 'create', calling method: .version_select at 0x7fb17e91daf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-778988028", "metadata": {"Type": "work"}}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:16:00.587551 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f3662076-567d-45ed-a575-b355844733cf tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:16:00.588350 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f3662076-567d-45ed-a575-b355844733cf tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005948 Jul 30 16:16:00.588861 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 621/1253] 10.222.0.37 () {60 vars in 1156 bytes} [Fri Jul 30 16:16:00 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 16:16:00.599357 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1cc8924b-578d-453a-88f1-a6468f5c4a82 tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] Action: 'create', calling method: .version_select at 0x7fb17e9c3e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-539083837", "metadata": {"Type": "work"}}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:16:00.600991 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1cc8924b-578d-453a-88f1-a6468f5c4a82 tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:16:00.601809 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1cc8924b-578d-453a-88f1-a6468f5c4a82 tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007605 Jul 30 16:16:00.602325 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 633/1254] 10.222.0.37 () {60 vars in 1156 bytes} [Fri Jul 30 16:16:00 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 16:16:00.612188 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3acf6e5d-2aac-4ebb-b4c9-28dd6bbad98a tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] Calling method '.version_select at 0x7fb17e8f2820>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:00.655542 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-3acf6e5d-2aac-4ebb-b4c9-28dd6bbad98a tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] HTTP exception thrown: Volume tempest-invalid-65912365 could not be found. Jul 30 16:16:00.656798 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3acf6e5d-2aac-4ebb-b4c9-28dd6bbad98a tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] Returning 404 to user: Volume tempest-invalid-65912365 could not be found. {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:16:00.657636 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-3acf6e5d-2aac-4ebb-b4c9-28dd6bbad98a tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/tempest-invalid-65912365" status: 404 len: 97 microversion: 2.1 time: 0.049599 Jul 30 16:16:00.658945 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 622/1255] 10.222.0.37 () {58 vars in 1212 bytes} [Fri Jul 30 16:16:00 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-65912365 => generated 97 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 16:16:00.668760 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-9f443be9-a9df-44a7-b103-351eff04026c tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004367 Jul 30 16:16:00.669261 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 634/1256] 10.222.0.37 () {58 vars in 1140 bytes} [Fri Jul 30 16:16:00 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 30 16:16:00.678798 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a5bd7fcd-7a0d-4bf8-a49f-5356ae391626 tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003630 Jul 30 16:16:00.679602 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 623/1257] 10.222.0.37 () {58 vars in 1137 bytes} [Fri Jul 30 16:16:00 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 30 16:16:00.687873 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f80c6d87-14c2-4a06-90c7-aa79bf05b493 tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] Calling method '.version_select at 0x7fb17e98bf70>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:00.716908 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-f80c6d87-14c2-4a06-90c7-aa79bf05b493 tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] HTTP exception thrown: Volume ed5374cb-9ff6-4c18-81a4-fa121bfa2b94 could not be found. Jul 30 16:16:00.717623 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f80c6d87-14c2-4a06-90c7-aa79bf05b493 tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] Returning 404 to user: Volume ed5374cb-9ff6-4c18-81a4-fa121bfa2b94 could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:16:00.718556 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f80c6d87-14c2-4a06-90c7-aa79bf05b493 tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/ed5374cb-9ff6-4c18-81a4-fa121bfa2b94" status: 404 len: 109 microversion: 2.1 time: 0.034331 Jul 30 16:16:00.719089 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 635/1258] 10.222.0.37 () {58 vars in 1248 bytes} [Fri Jul 30 16:16:00 2021] DELETE /compute/v2.1/os-volumes/ed5374cb-9ff6-4c18-81a4-fa121bfa2b94 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:16:00.728837 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b44fc020-5a35-4e2c-98a9-fedb254e2cbb tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] Calling method '.version_select at 0x7fb17e9c60d0>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:00.755291 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-b44fc020-5a35-4e2c-98a9-fedb254e2cbb tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] HTTP exception thrown: Volume 0183e312-35e3-49c4-a199-bd85aafb8a54 could not be found. Jul 30 16:16:00.756382 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b44fc020-5a35-4e2c-98a9-fedb254e2cbb tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] Returning 404 to user: Volume 0183e312-35e3-49c4-a199-bd85aafb8a54 could not be found. {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:16:00.757202 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b44fc020-5a35-4e2c-98a9-fedb254e2cbb tempest-VolumesNegativeTest-117059512 tempest-VolumesNegativeTest-117059512-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/0183e312-35e3-49c4-a199-bd85aafb8a54" status: 404 len: 109 microversion: 2.1 time: 0.031994 Jul 30 16:16:00.757754 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 624/1259] 10.222.0.37 () {58 vars in 1245 bytes} [Fri Jul 30 16:16:00 2021] GET /compute/v2.1/os-volumes/0183e312-35e3-49c4-a199-bd85aafb8a54 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:16:38.793849 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-8bb85594-3f90-435f-a24e-95e6b6d31c3e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1972788149", "imageRef": "eea29a7d-10c3-489a-adee-10be2e7a26bd", "flavorRef": "452", "networks": [{"uuid": "87fed68c-4369-43e9-8471-dff6ec2c72fa"}]}} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:16:38.855588 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.network.neutron [None req-8bb85594-3f90-435f-a24e-95e6b6d31c3e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] validate_networks() for [('87fed68c-4369-43e9-8471-dff6ec2c72fa', None, None, None)] {{(pid=107452) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:16:39.184360 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-8bb85594-3f90-435f-a24e-95e6b6d31c3e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Flavor limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:16:39.184782 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-8bb85594-3f90-435f-a24e-95e6b6d31c3e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Image limits 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:16:39.185252 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-8bb85594-3f90-435f-a24e-95e6b6d31c3e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Flavor pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:16:39.185655 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-8bb85594-3f90-435f-a24e-95e6b6d31c3e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Image pref 0:0:0 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:16:39.186062 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.virt.hardware [None req-8bb85594-3f90-435f-a24e-95e6b6d31c3e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:16:39.195238 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8bb85594-3f90-435f-a24e-95e6b6d31c3e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:39.195677 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8bb85594-3f90-435f-a24e-95e6b6d31c3e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:39.196471 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8bb85594-3f90-435f-a24e-95e6b6d31c3e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:39.196896 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-8bb85594-3f90-435f-a24e-95e6b6d31c3e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:39.212764 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-8bb85594-3f90-435f-a24e-95e6b6d31c3e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Getting quotas for project 76ee051b3b5e4e9ba39b5b3a11792eb4. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:16:39.216565 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.quota [None req-8bb85594-3f90-435f-a24e-95e6b6d31c3e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Getting quotas for user f74cdab32b87476998702e08bd60fc2a and project 76ee051b3b5e4e9ba39b5b3a11792eb4. Resources: {'cores', 'instances', 'ram'} {{(pid=107452) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:16:39.227363 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8bb85594-3f90-435f-a24e-95e6b6d31c3e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Going to run 1 instances... {{(pid=107452) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:16:39.229599 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-8bb85594-3f90-435f-a24e-95e6b6d31c3e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 21b40755-f7e4-4a93-8e70-3b915cbfabdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eea29a7d-10c3-489a-adee-10be2e7a26bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:16:39.274373 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-8bb85594-3f90-435f-a24e-95e6b6d31c3e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.485123 Jul 30 16:16:39.275112 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 636/1260] 10.222.0.37 () {60 vars in 1147 bytes} [Fri Jul 30 16:16:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 16:16:39.286588 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a901986a-65c9-47da-9d0f-d3ce77bc306c tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:39.287397 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a901986a-65c9-47da-9d0f-d3ce77bc306c tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 21b40755-f7e4-4a93-8e70-3b915cbfabdd] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:39.339829 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a901986a-65c9-47da-9d0f-d3ce77bc306c tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:39.346354 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a901986a-65c9-47da-9d0f-d3ce77bc306c tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd" status: 200 len: 1214 microversion: 2.1 time: 0.065224 Jul 30 16:16:39.348076 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 625/1261] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:39 2021] GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:40.363712 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f3f37ee0-dbfd-456b-a802-55bacf691f3a tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:40.364492 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f3f37ee0-dbfd-456b-a802-55bacf691f3a tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 21b40755-f7e4-4a93-8e70-3b915cbfabdd] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:40.370337 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f3f37ee0-dbfd-456b-a802-55bacf691f3a tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:40.371010 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f3f37ee0-dbfd-456b-a802-55bacf691f3a tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:40.371810 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f3f37ee0-dbfd-456b-a802-55bacf691f3a tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:40.372242 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f3f37ee0-dbfd-456b-a802-55bacf691f3a tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:40.435057 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f3f37ee0-dbfd-456b-a802-55bacf691f3a tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:40.442522 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f3f37ee0-dbfd-456b-a802-55bacf691f3a tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd" status: 200 len: 1272 microversion: 2.1 time: 0.083189 Jul 30 16:16:40.443092 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 637/1262] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:40 2021] GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd => generated 1272 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:41.395493 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-f23d3c6b-a682-4bdd-b73f-df2d7971e508 req-9b64f737-e740-4cde-8345-ea780ccd3f30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21b40755-f7e4-4a93-8e70-3b915cbfabdd", "tag": "5f6607f5-506d-47e4-8832-25e2caa7cb6d"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:16:41.397156 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:16:41.397156 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:16:41.404914 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-f23d3c6b-a682-4bdd-b73f-df2d7971e508 req-9b64f737-e740-4cde-8345-ea780ccd3f30 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:41.405573 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-f23d3c6b-a682-4bdd-b73f-df2d7971e508 req-9b64f737-e740-4cde-8345-ea780ccd3f30 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:41.417351 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-f23d3c6b-a682-4bdd-b73f-df2d7971e508 req-9b64f737-e740-4cde-8345-ea780ccd3f30 service nova] Creating event network-changed:5f6607f5-506d-47e4-8832-25e2caa7cb6d for instance 21b40755-f7e4-4a93-8e70-3b915cbfabdd on hv-cinder-80304 Jul 30 16:16:41.422124 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-f23d3c6b-a682-4bdd-b73f-df2d7971e508 req-9b64f737-e740-4cde-8345-ea780ccd3f30 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031095 Jul 30 16:16:41.422572 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 626/1263] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:16:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:16:41.458376 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6c4ba034-fe6d-45f5-b385-06c8cf368dc4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:41.458995 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6c4ba034-fe6d-45f5-b385-06c8cf368dc4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 21b40755-f7e4-4a93-8e70-3b915cbfabdd] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:41.464838 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6c4ba034-fe6d-45f5-b385-06c8cf368dc4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:41.465281 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6c4ba034-fe6d-45f5-b385-06c8cf368dc4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:41.466042 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6c4ba034-fe6d-45f5-b385-06c8cf368dc4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:41.466470 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6c4ba034-fe6d-45f5-b385-06c8cf368dc4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:41.585455 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6c4ba034-fe6d-45f5-b385-06c8cf368dc4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:41.592476 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6c4ba034-fe6d-45f5-b385-06c8cf368dc4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd" status: 200 len: 1314 microversion: 2.1 time: 0.137956 Jul 30 16:16:41.593031 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 638/1264] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:41 2021] GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd => generated 1314 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:42.609561 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4e1c5548-17a8-4eb5-ba5f-5aea71a21d5c tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:42.610176 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4e1c5548-17a8-4eb5-ba5f-5aea71a21d5c tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 21b40755-f7e4-4a93-8e70-3b915cbfabdd] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:42.617907 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4e1c5548-17a8-4eb5-ba5f-5aea71a21d5c tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:42.618359 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4e1c5548-17a8-4eb5-ba5f-5aea71a21d5c tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:42.619125 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4e1c5548-17a8-4eb5-ba5f-5aea71a21d5c tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:42.619590 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4e1c5548-17a8-4eb5-ba5f-5aea71a21d5c tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:42.740114 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4e1c5548-17a8-4eb5-ba5f-5aea71a21d5c tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:42.747453 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4e1c5548-17a8-4eb5-ba5f-5aea71a21d5c tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd" status: 200 len: 1314 microversion: 2.1 time: 0.141900 Jul 30 16:16:42.748020 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 627/1265] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:42 2021] GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:43.763503 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-95e58daa-962a-4aa9-bb49-be1b433592c0 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:43.764110 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-95e58daa-962a-4aa9-bb49-be1b433592c0 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 21b40755-f7e4-4a93-8e70-3b915cbfabdd] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:43.770456 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-95e58daa-962a-4aa9-bb49-be1b433592c0 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:43.770892 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-95e58daa-962a-4aa9-bb49-be1b433592c0 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:43.771679 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-95e58daa-962a-4aa9-bb49-be1b433592c0 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:43.772100 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-95e58daa-962a-4aa9-bb49-be1b433592c0 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:43.893878 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-95e58daa-962a-4aa9-bb49-be1b433592c0 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:43.901409 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-95e58daa-962a-4aa9-bb49-be1b433592c0 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd" status: 200 len: 1314 microversion: 2.1 time: 0.141552 Jul 30 16:16:43.901964 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 639/1266] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:43 2021] GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:44.917834 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-db8c2bb4-36db-4ed3-9d45-730e810c6915 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:44.918535 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-db8c2bb4-36db-4ed3-9d45-730e810c6915 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 21b40755-f7e4-4a93-8e70-3b915cbfabdd] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:44.924687 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-db8c2bb4-36db-4ed3-9d45-730e810c6915 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:44.925131 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-db8c2bb4-36db-4ed3-9d45-730e810c6915 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:44.926479 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-db8c2bb4-36db-4ed3-9d45-730e810c6915 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:44.927532 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-db8c2bb4-36db-4ed3-9d45-730e810c6915 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:45.054891 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-db8c2bb4-36db-4ed3-9d45-730e810c6915 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:45.065342 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-db8c2bb4-36db-4ed3-9d45-730e810c6915 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd" status: 200 len: 1314 microversion: 2.1 time: 0.150975 Jul 30 16:16:45.066307 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 628/1267] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:44 2021] GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:46.088060 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a4378938-b940-46cc-83fa-48965f2733f6 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:46.088633 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a4378938-b940-46cc-83fa-48965f2733f6 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 21b40755-f7e4-4a93-8e70-3b915cbfabdd] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:46.094404 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a4378938-b940-46cc-83fa-48965f2733f6 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:46.094884 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a4378938-b940-46cc-83fa-48965f2733f6 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:46.095683 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a4378938-b940-46cc-83fa-48965f2733f6 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:46.096120 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a4378938-b940-46cc-83fa-48965f2733f6 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:46.216654 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-a4378938-b940-46cc-83fa-48965f2733f6 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:46.224429 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a4378938-b940-46cc-83fa-48965f2733f6 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd" status: 200 len: 1314 microversion: 2.1 time: 0.140145 Jul 30 16:16:46.224987 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 640/1268] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:46 2021] GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd => generated 1314 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:46.777847 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-065d6756-a595-4d6d-ad47-c3738759b877 req-b8453ea2-e4dc-4881-8ad1-b4c0fbd3a5eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b40755-f7e4-4a93-8e70-3b915cbfabdd", "name": "network-vif-plugged", "status": "completed", "tag": "5f6607f5-506d-47e4-8832-25e2caa7cb6d"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:16:46.779411 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:16:46.779411 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:16:46.786944 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-065d6756-a595-4d6d-ad47-c3738759b877 req-b8453ea2-e4dc-4881-8ad1-b4c0fbd3a5eb service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:46.787418 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-065d6756-a595-4d6d-ad47-c3738759b877 req-b8453ea2-e4dc-4881-8ad1-b4c0fbd3a5eb service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:46.798443 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-065d6756-a595-4d6d-ad47-c3738759b877 req-b8453ea2-e4dc-4881-8ad1-b4c0fbd3a5eb service nova] Creating event network-vif-plugged:5f6607f5-506d-47e4-8832-25e2caa7cb6d for instance 21b40755-f7e4-4a93-8e70-3b915cbfabdd on hv-cinder-80304 Jul 30 16:16:46.803313 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-065d6756-a595-4d6d-ad47-c3738759b877 req-b8453ea2-e4dc-4881-8ad1-b4c0fbd3a5eb service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029483 Jul 30 16:16:46.803900 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 629/1269] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:16:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:16:47.240970 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-2aefb74e-b903-4a85-82c4-618c1dd6856b tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:47.241493 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-2aefb74e-b903-4a85-82c4-618c1dd6856b tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 21b40755-f7e4-4a93-8e70-3b915cbfabdd] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:47.247431 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2aefb74e-b903-4a85-82c4-618c1dd6856b tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:47.247884 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2aefb74e-b903-4a85-82c4-618c1dd6856b tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:47.248648 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2aefb74e-b903-4a85-82c4-618c1dd6856b tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:47.249081 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2aefb74e-b903-4a85-82c4-618c1dd6856b tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:47.366295 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-2aefb74e-b903-4a85-82c4-618c1dd6856b tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:47.373315 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-2aefb74e-b903-4a85-82c4-618c1dd6856b tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd" status: 200 len: 1314 microversion: 2.1 time: 0.136240 Jul 30 16:16:47.373869 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 641/1270] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:47 2021] GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd => generated 1314 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:48.390082 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a91f0f89-5198-4d4d-b3d4-fa57089d8eb4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:48.390777 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a91f0f89-5198-4d4d-b3d4-fa57089d8eb4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 21b40755-f7e4-4a93-8e70-3b915cbfabdd] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:48.397649 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a91f0f89-5198-4d4d-b3d4-fa57089d8eb4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:48.398126 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a91f0f89-5198-4d4d-b3d4-fa57089d8eb4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:48.399167 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a91f0f89-5198-4d4d-b3d4-fa57089d8eb4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:48.399603 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a91f0f89-5198-4d4d-b3d4-fa57089d8eb4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:48.518069 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a91f0f89-5198-4d4d-b3d4-fa57089d8eb4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:48.526224 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a91f0f89-5198-4d4d-b3d4-fa57089d8eb4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd" status: 200 len: 1497 microversion: 2.1 time: 0.140164 Jul 30 16:16:48.526774 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 630/1271] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:48 2021] GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd => generated 1497 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:48.924764 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-79d42bd7-d281-4ff2-95fb-fc8bcbe5b7b8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:48.925843 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-79d42bd7-d281-4ff2-95fb-fc8bcbe5b7b8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 21b40755-f7e4-4a93-8e70-3b915cbfabdd] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:48.931576 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-79d42bd7-d281-4ff2-95fb-fc8bcbe5b7b8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:48.932019 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-79d42bd7-d281-4ff2-95fb-fc8bcbe5b7b8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:48.932774 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-79d42bd7-d281-4ff2-95fb-fc8bcbe5b7b8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:48.933203 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-79d42bd7-d281-4ff2-95fb-fc8bcbe5b7b8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:48.957085 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-79d42bd7-d281-4ff2-95fb-fc8bcbe5b7b8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 21b40755-f7e4-4a93-8e70-3b915cbfabdd] Going to try to terminate instance {{(pid=107452) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:16:49.032615 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-79d42bd7-d281-4ff2-95fb-fc8bcbe5b7b8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "DELETE /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd" status: 204 len: 0 microversion: 2.1 time: 0.110883 Jul 30 16:16:49.033715 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 642/1272] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:16:48 2021] DELETE /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 16:16:49.042194 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3728bdd4-1106-4ccb-83d2-47cc8027e48f tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:49.042811 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-3728bdd4-1106-4ccb-83d2-47cc8027e48f tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 21b40755-f7e4-4a93-8e70-3b915cbfabdd] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:49.048726 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3728bdd4-1106-4ccb-83d2-47cc8027e48f tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:49.049185 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3728bdd4-1106-4ccb-83d2-47cc8027e48f tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:49.049954 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3728bdd4-1106-4ccb-83d2-47cc8027e48f tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:49.050915 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3728bdd4-1106-4ccb-83d2-47cc8027e48f tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:49.318645 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3728bdd4-1106-4ccb-83d2-47cc8027e48f tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:49.325942 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-3728bdd4-1106-4ccb-83d2-47cc8027e48f tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd" status: 200 len: 1503 microversion: 2.1 time: 0.287490 Jul 30 16:16:49.326497 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 631/1273] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:49 2021] GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd => generated 1503 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:50.343675 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-a0fd6893-a7d2-4f31-9edd-73b79e8a26d3 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:50.344360 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-a0fd6893-a7d2-4f31-9edd-73b79e8a26d3 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 21b40755-f7e4-4a93-8e70-3b915cbfabdd] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:50.350636 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a0fd6893-a7d2-4f31-9edd-73b79e8a26d3 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:50.351073 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a0fd6893-a7d2-4f31-9edd-73b79e8a26d3 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:50.351848 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a0fd6893-a7d2-4f31-9edd-73b79e8a26d3 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:50.352268 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-a0fd6893-a7d2-4f31-9edd-73b79e8a26d3 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:50.524149 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-a0fd6893-a7d2-4f31-9edd-73b79e8a26d3 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:50.531440 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-a0fd6893-a7d2-4f31-9edd-73b79e8a26d3 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd" status: 200 len: 1503 microversion: 2.1 time: 0.191699 Jul 30 16:16:50.532010 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 643/1274] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:50 2021] GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd => generated 1503 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:50.929318 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-904a50ce-6014-4e10-b774-cc9fb3fd8ebe req-7d3c3206-9b16-4e09-b839-65e7b8e13972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b40755-f7e4-4a93-8e70-3b915cbfabdd", "name": "network-vif-deleted", "tag": "5f6607f5-506d-47e4-8832-25e2caa7cb6d"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:16:50.931030 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:16:50.931030 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:16:50.938208 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-904a50ce-6014-4e10-b774-cc9fb3fd8ebe req-7d3c3206-9b16-4e09-b839-65e7b8e13972 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:50.938646 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-904a50ce-6014-4e10-b774-cc9fb3fd8ebe req-7d3c3206-9b16-4e09-b839-65e7b8e13972 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:50.949953 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-904a50ce-6014-4e10-b774-cc9fb3fd8ebe req-7d3c3206-9b16-4e09-b839-65e7b8e13972 service nova] Creating event network-vif-deleted:5f6607f5-506d-47e4-8832-25e2caa7cb6d for instance 21b40755-f7e4-4a93-8e70-3b915cbfabdd on hv-cinder-80304 Jul 30 16:16:50.954807 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-904a50ce-6014-4e10-b774-cc9fb3fd8ebe req-7d3c3206-9b16-4e09-b839-65e7b8e13972 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029666 Jul 30 16:16:50.955431 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 632/1275] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:16:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:16:51.200656 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ccfaa502-b1fb-4cd1-a844-e270fd3a97fe tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:51.201060 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ccfaa502-b1fb-4cd1-a844-e270fd3a97fe tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:51.207793 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ccfaa502-b1fb-4cd1-a844-e270fd3a97fe tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:51.208228 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ccfaa502-b1fb-4cd1-a844-e270fd3a97fe tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:51.209014 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ccfaa502-b1fb-4cd1-a844-e270fd3a97fe tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:51.209437 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ccfaa502-b1fb-4cd1-a844-e270fd3a97fe tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:51.233829 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ccfaa502-b1fb-4cd1-a844-e270fd3a97fe tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Going to try to terminate instance {{(pid=107452) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:16:51.308693 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ccfaa502-b1fb-4cd1-a844-e270fd3a97fe tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "DELETE /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 204 len: 0 microversion: 2.1 time: 0.111602 Jul 30 16:16:51.309339 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 644/1276] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:16:51 2021] DELETE /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 16:16:51.318396 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-608c1e07-9bef-4be9-9ce9-8e37863d7d8d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:51.319095 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-608c1e07-9bef-4be9-9ce9-8e37863d7d8d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:51.325391 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-608c1e07-9bef-4be9-9ce9-8e37863d7d8d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:51.325844 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-608c1e07-9bef-4be9-9ce9-8e37863d7d8d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:51.326614 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-608c1e07-9bef-4be9-9ce9-8e37863d7d8d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:51.327051 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-608c1e07-9bef-4be9-9ce9-8e37863d7d8d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:51.452718 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-608c1e07-9bef-4be9-9ce9-8e37863d7d8d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:51.461744 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-608c1e07-9bef-4be9-9ce9-8e37863d7d8d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 200 len: 1579 microversion: 2.1 time: 0.147534 Jul 30 16:16:51.462310 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 633/1277] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:51 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 1579 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:51.548347 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-4ba1a2de-6f65-43e4-837f-89f55dbf9933 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:51.549052 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-4ba1a2de-6f65-43e4-837f-89f55dbf9933 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 21b40755-f7e4-4a93-8e70-3b915cbfabdd] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:51.555734 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4ba1a2de-6f65-43e4-837f-89f55dbf9933 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:51.556187 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4ba1a2de-6f65-43e4-837f-89f55dbf9933 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:51.556954 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4ba1a2de-6f65-43e4-837f-89f55dbf9933 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:51.557385 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4ba1a2de-6f65-43e4-837f-89f55dbf9933 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:51.571547 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-4ba1a2de-6f65-43e4-837f-89f55dbf9933 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] HTTP exception thrown: Instance 21b40755-f7e4-4a93-8e70-3b915cbfabdd could not be found. Jul 30 16:16:51.572129 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-4ba1a2de-6f65-43e4-837f-89f55dbf9933 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Returning 404 to user: Instance 21b40755-f7e4-4a93-8e70-3b915cbfabdd could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:16:51.572926 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-4ba1a2de-6f65-43e4-837f-89f55dbf9933 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd" status: 404 len: 111 microversion: 2.1 time: 0.028651 Jul 30 16:16:51.573442 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 645/1278] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:51 2021] GET /compute/v2.1/servers/21b40755-f7e4-4a93-8e70-3b915cbfabdd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:16:51.620035 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-bd029d3a-ef93-49ab-8830-7b380e77bf14 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-910219114", "imageRef": "eea29a7d-10c3-489a-adee-10be2e7a26bd", "flavorRef": "452", "networks": [{"uuid": "87fed68c-4369-43e9-8471-dff6ec2c72fa"}]}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:16:51.673206 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.network.neutron [None req-bd029d3a-ef93-49ab-8830-7b380e77bf14 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] validate_networks() for [('87fed68c-4369-43e9-8471-dff6ec2c72fa', None, None, None)] {{(pid=107453) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:16:52.016000 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-bd029d3a-ef93-49ab-8830-7b380e77bf14 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Flavor limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:16:52.016561 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-bd029d3a-ef93-49ab-8830-7b380e77bf14 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Image limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:16:52.016887 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-bd029d3a-ef93-49ab-8830-7b380e77bf14 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Flavor pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:16:52.017325 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-bd029d3a-ef93-49ab-8830-7b380e77bf14 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Image pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:16:52.017738 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-bd029d3a-ef93-49ab-8830-7b380e77bf14 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:16:52.026777 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bd029d3a-ef93-49ab-8830-7b380e77bf14 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:52.027256 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bd029d3a-ef93-49ab-8830-7b380e77bf14 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:52.028058 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bd029d3a-ef93-49ab-8830-7b380e77bf14 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:52.028490 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-bd029d3a-ef93-49ab-8830-7b380e77bf14 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:52.045355 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-bd029d3a-ef93-49ab-8830-7b380e77bf14 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Getting quotas for project 76ee051b3b5e4e9ba39b5b3a11792eb4. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:16:52.049218 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-bd029d3a-ef93-49ab-8830-7b380e77bf14 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Getting quotas for user f74cdab32b87476998702e08bd60fc2a and project 76ee051b3b5e4e9ba39b5b3a11792eb4. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:16:52.060321 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-bd029d3a-ef93-49ab-8830-7b380e77bf14 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Going to run 1 instances... {{(pid=107453) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:16:52.062566 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-bd029d3a-ef93-49ab-8830-7b380e77bf14 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 48ebdf43-59cd-4ddc-9f96-4f53f22016d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eea29a7d-10c3-489a-adee-10be2e7a26bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:16:52.106361 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-bd029d3a-ef93-49ab-8830-7b380e77bf14 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.489900 Jul 30 16:16:52.107006 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 634/1279] 10.222.0.37 () {60 vars in 1147 bytes} [Fri Jul 30 16:16:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 16:16:52.117089 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-550a8fd8-32f0-4e0e-b9c6-4b4c07fb5247 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:52.117699 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-550a8fd8-32f0-4e0e-b9c6-4b4c07fb5247 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 48ebdf43-59cd-4ddc-9f96-4f53f22016d7] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:52.169296 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-550a8fd8-32f0-4e0e-b9c6-4b4c07fb5247 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:52.176400 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-550a8fd8-32f0-4e0e-b9c6-4b4c07fb5247 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7" status: 200 len: 1213 microversion: 2.1 time: 0.063500 Jul 30 16:16:52.176961 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 646/1280] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:52 2021] GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:52.479040 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-46730978-7ae4-407e-93b4-bd79e377f5a8 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:52.479684 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-46730978-7ae4-407e-93b4-bd79e377f5a8 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:52.486302 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-46730978-7ae4-407e-93b4-bd79e377f5a8 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:52.486754 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-46730978-7ae4-407e-93b4-bd79e377f5a8 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:52.487548 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-46730978-7ae4-407e-93b4-bd79e377f5a8 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:52.488580 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-46730978-7ae4-407e-93b4-bd79e377f5a8 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:52.621319 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-46730978-7ae4-407e-93b4-bd79e377f5a8 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:52.629526 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-46730978-7ae4-407e-93b4-bd79e377f5a8 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 200 len: 1579 microversion: 2.1 time: 0.153426 Jul 30 16:16:52.630349 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 635/1281] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:52 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:16:53.193591 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-75b1d4a4-f2be-4567-8c5a-9cbe726ff8e4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:53.195386 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-75b1d4a4-f2be-4567-8c5a-9cbe726ff8e4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 48ebdf43-59cd-4ddc-9f96-4f53f22016d7] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:53.202675 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-75b1d4a4-f2be-4567-8c5a-9cbe726ff8e4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:53.203384 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-75b1d4a4-f2be-4567-8c5a-9cbe726ff8e4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:53.204817 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-75b1d4a4-f2be-4567-8c5a-9cbe726ff8e4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:53.205427 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-75b1d4a4-f2be-4567-8c5a-9cbe726ff8e4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:53.275364 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-75b1d4a4-f2be-4567-8c5a-9cbe726ff8e4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:53.283452 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-75b1d4a4-f2be-4567-8c5a-9cbe726ff8e4 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7" status: 200 len: 1271 microversion: 2.1 time: 0.094538 Jul 30 16:16:53.284093 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 647/1282] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:53 2021] GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:53.648050 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a94db093-72c3-42bc-aafa-33608424dec3 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:53.649545 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a94db093-72c3-42bc-aafa-33608424dec3 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:53.656980 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a94db093-72c3-42bc-aafa-33608424dec3 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:53.657700 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a94db093-72c3-42bc-aafa-33608424dec3 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:53.658665 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a94db093-72c3-42bc-aafa-33608424dec3 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:53.659101 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a94db093-72c3-42bc-aafa-33608424dec3 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:53.940621 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a94db093-72c3-42bc-aafa-33608424dec3 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:53.952967 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a94db093-72c3-42bc-aafa-33608424dec3 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 200 len: 1511 microversion: 2.1 time: 0.309202 Jul 30 16:16:53.963574 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 636/1283] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:53 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 1511 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:54.139173 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-0181130c-16de-454f-9cf8-819580db7007 req-320b8e0b-59df-4e2e-ae78-1da9ab08a656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36700cb8-81e3-47e4-96f9-9b417e29aef8", "name": "network-vif-deleted", "tag": "1d4d5279-4d0d-4100-9111-bce087569c04"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:16:54.140752 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:16:54.140752 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:16:54.152256 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-0181130c-16de-454f-9cf8-819580db7007 req-320b8e0b-59df-4e2e-ae78-1da9ab08a656 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:54.152630 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-0181130c-16de-454f-9cf8-819580db7007 req-320b8e0b-59df-4e2e-ae78-1da9ab08a656 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:54.165248 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-0181130c-16de-454f-9cf8-819580db7007 req-320b8e0b-59df-4e2e-ae78-1da9ab08a656 service nova] Creating event network-vif-deleted:1d4d5279-4d0d-4100-9111-bce087569c04 for instance 36700cb8-81e3-47e4-96f9-9b417e29aef8 on hv-cinder-80304 Jul 30 16:16:54.170622 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-0181130c-16de-454f-9cf8-819580db7007 req-320b8e0b-59df-4e2e-ae78-1da9ab08a656 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034639 Jul 30 16:16:54.171563 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 648/1284] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:16:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:16:54.300926 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-3944785c-895f-4bcb-aa41-7b9b6f6d3bf9 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:54.301985 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-3944785c-895f-4bcb-aa41-7b9b6f6d3bf9 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 48ebdf43-59cd-4ddc-9f96-4f53f22016d7] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:54.308458 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3944785c-895f-4bcb-aa41-7b9b6f6d3bf9 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:54.309119 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3944785c-895f-4bcb-aa41-7b9b6f6d3bf9 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:54.309901 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3944785c-895f-4bcb-aa41-7b9b6f6d3bf9 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:54.310505 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-3944785c-895f-4bcb-aa41-7b9b6f6d3bf9 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:54.390208 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-2f491eea-3e30-4171-854f-c432585961bf req-c67a5fc0-823c-4477-bcef-190b5093cfbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48ebdf43-59cd-4ddc-9f96-4f53f22016d7", "tag": "5139c3f3-d435-4911-a997-6eb9f2353572"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:16:54.391722 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:16:54.391722 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:16:54.416216 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-2f491eea-3e30-4171-854f-c432585961bf req-c67a5fc0-823c-4477-bcef-190b5093cfbc service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:54.416925 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-2f491eea-3e30-4171-854f-c432585961bf req-c67a5fc0-823c-4477-bcef-190b5093cfbc service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:54.434082 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-2f491eea-3e30-4171-854f-c432585961bf req-c67a5fc0-823c-4477-bcef-190b5093cfbc service nova] Creating event network-changed:5139c3f3-d435-4911-a997-6eb9f2353572 for instance 48ebdf43-59cd-4ddc-9f96-4f53f22016d7 on hv-cinder-80304 Jul 30 16:16:54.439840 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-2f491eea-3e30-4171-854f-c432585961bf req-c67a5fc0-823c-4477-bcef-190b5093cfbc service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055154 Jul 30 16:16:54.441655 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 649/1285] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:16:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:16:54.447648 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-3944785c-895f-4bcb-aa41-7b9b6f6d3bf9 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:54.457926 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-3944785c-895f-4bcb-aa41-7b9b6f6d3bf9 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7" status: 200 len: 1313 microversion: 2.1 time: 0.161030 Jul 30 16:16:54.459034 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 637/1286] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:54 2021] GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:54.971355 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1f21552f-083b-4648-aec7-f0252fbe0ce1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:54.972315 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1f21552f-083b-4648-aec7-f0252fbe0ce1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:54.978636 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f21552f-083b-4648-aec7-f0252fbe0ce1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:54.979087 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f21552f-083b-4648-aec7-f0252fbe0ce1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:54.979890 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f21552f-083b-4648-aec7-f0252fbe0ce1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:54.980331 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1f21552f-083b-4648-aec7-f0252fbe0ce1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:54.994168 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-1f21552f-083b-4648-aec7-f0252fbe0ce1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] HTTP exception thrown: Instance 36700cb8-81e3-47e4-96f9-9b417e29aef8 could not be found. Jul 30 16:16:54.994917 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1f21552f-083b-4648-aec7-f0252fbe0ce1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Returning 404 to user: Instance 36700cb8-81e3-47e4-96f9-9b417e29aef8 could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:16:54.995796 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1f21552f-083b-4648-aec7-f0252fbe0ce1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 404 len: 111 microversion: 2.1 time: 0.029085 Jul 30 16:16:54.996351 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 650/1287] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:54 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:16:55.106420 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e2be913a-a9c9-41c5-a6b5-f9dddb12fd6d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1820305297", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2065592267", "security_groups": [{"name": "tempest-secgroup-smoke-1585456609"}], "block_device_mapping_v2": [{"uuid": "b15b3cdf-9a21-410e-b9fa-4437822d44b5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7d0da8fd-0a56-4002-b0c2-d66355f139a4"}]}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:16:55.212811 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.network.neutron [None req-e2be913a-a9c9-41c5-a6b5-f9dddb12fd6d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] validate_networks() for [('7d0da8fd-0a56-4002-b0c2-d66355f139a4', None, None, None)] {{(pid=107453) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:16:55.474167 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c71ad4ce-3e10-4cea-9a58-47f5ee5710e2 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:55.474790 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c71ad4ce-3e10-4cea-9a58-47f5ee5710e2 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 48ebdf43-59cd-4ddc-9f96-4f53f22016d7] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:55.480546 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c71ad4ce-3e10-4cea-9a58-47f5ee5710e2 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:55.480999 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c71ad4ce-3e10-4cea-9a58-47f5ee5710e2 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:55.481774 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c71ad4ce-3e10-4cea-9a58-47f5ee5710e2 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:55.482208 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c71ad4ce-3e10-4cea-9a58-47f5ee5710e2 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:55.589867 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-e2be913a-a9c9-41c5-a6b5-f9dddb12fd6d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Flavor limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:16:55.590293 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-e2be913a-a9c9-41c5-a6b5-f9dddb12fd6d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Image limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:16:55.590875 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-e2be913a-a9c9-41c5-a6b5-f9dddb12fd6d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Flavor pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:16:55.591320 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-e2be913a-a9c9-41c5-a6b5-f9dddb12fd6d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Image pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:16:55.591734 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-e2be913a-a9c9-41c5-a6b5-f9dddb12fd6d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:16:55.600578 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e2be913a-a9c9-41c5-a6b5-f9dddb12fd6d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:55.600962 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e2be913a-a9c9-41c5-a6b5-f9dddb12fd6d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:55.601768 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e2be913a-a9c9-41c5-a6b5-f9dddb12fd6d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:55.602263 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e2be913a-a9c9-41c5-a6b5-f9dddb12fd6d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:55.604744 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c71ad4ce-3e10-4cea-9a58-47f5ee5710e2 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:55.612031 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c71ad4ce-3e10-4cea-9a58-47f5ee5710e2 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7" status: 200 len: 1313 microversion: 2.1 time: 0.142192 Jul 30 16:16:55.612588 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 651/1288] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:55 2021] GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7 => generated 1313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:16:55.622570 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-e2be913a-a9c9-41c5-a6b5-f9dddb12fd6d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Getting quotas for project 07bf3493a71648c895b14d999b3bfb1e. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:16:55.626369 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-e2be913a-a9c9-41c5-a6b5-f9dddb12fd6d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Getting quotas for user ea3885b43f9a4d32aab4abebece046c8 and project 07bf3493a71648c895b14d999b3bfb1e. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:16:55.693444 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e2be913a-a9c9-41c5-a6b5-f9dddb12fd6d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Going to run 1 instances... {{(pid=107453) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:16:55.695544 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e2be913a-a9c9-41c5-a6b5-f9dddb12fd6d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b15b3cdf-9a21-410e-b9fa-4437822d44b5',volume_size=None,volume_type=None)] {{(pid=107453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:16:55.817284 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e2be913a-a9c9-41c5-a6b5-f9dddb12fd6d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.714296 Jul 30 16:16:55.817943 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 638/1289] 10.222.0.37 () {60 vars in 1147 bytes} [Fri Jul 30 16:16:55 2021] POST /compute/v2.1/servers => generated 406 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 16:16:55.827505 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-065f6820-9a5d-4153-b9d5-a9cb6f7396a8 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:55.828114 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-065f6820-9a5d-4153-b9d5-a9cb6f7396a8 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:55.882994 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-065f6820-9a5d-4153-b9d5-a9cb6f7396a8 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:55.889527 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-065f6820-9a5d-4153-b9d5-a9cb6f7396a8 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 200 len: 1095 microversion: 2.1 time: 0.065557 Jul 30 16:16:55.890077 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 652/1290] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:55 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:56.631513 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e2abe0d2-9a99-4f7f-9951-6afaf0675493 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:56.632159 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e2abe0d2-9a99-4f7f-9951-6afaf0675493 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 48ebdf43-59cd-4ddc-9f96-4f53f22016d7] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:56.638111 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e2abe0d2-9a99-4f7f-9951-6afaf0675493 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:56.638571 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e2abe0d2-9a99-4f7f-9951-6afaf0675493 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:56.639389 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e2abe0d2-9a99-4f7f-9951-6afaf0675493 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:56.639828 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e2abe0d2-9a99-4f7f-9951-6afaf0675493 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:56.832995 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e2abe0d2-9a99-4f7f-9951-6afaf0675493 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:56.844849 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e2abe0d2-9a99-4f7f-9951-6afaf0675493 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7" status: 200 len: 1313 microversion: 2.1 time: 0.216545 Jul 30 16:16:56.845765 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 639/1291] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:56 2021] GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:56.906979 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f00f33b3-f125-4b99-884f-03c2e57117fa tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:56.907741 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f00f33b3-f125-4b99-884f-03c2e57117fa tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:56.917480 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f00f33b3-f125-4b99-884f-03c2e57117fa tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:56.918334 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f00f33b3-f125-4b99-884f-03c2e57117fa tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:56.919674 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f00f33b3-f125-4b99-884f-03c2e57117fa tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:56.920070 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f00f33b3-f125-4b99-884f-03c2e57117fa tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:57.023000 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f00f33b3-f125-4b99-884f-03c2e57117fa tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:57.030881 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f00f33b3-f125-4b99-884f-03c2e57117fa tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 200 len: 1211 microversion: 2.1 time: 0.127560 Jul 30 16:16:57.032029 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 653/1292] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:56 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 1211 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:57.862069 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d957d111-0401-42db-bc99-d4019baa257e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:57.863956 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d957d111-0401-42db-bc99-d4019baa257e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 48ebdf43-59cd-4ddc-9f96-4f53f22016d7] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:57.869916 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d957d111-0401-42db-bc99-d4019baa257e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:57.870373 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d957d111-0401-42db-bc99-d4019baa257e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:57.871170 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d957d111-0401-42db-bc99-d4019baa257e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:57.871608 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d957d111-0401-42db-bc99-d4019baa257e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:58.011495 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d957d111-0401-42db-bc99-d4019baa257e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:58.019689 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d957d111-0401-42db-bc99-d4019baa257e tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7" status: 200 len: 1313 microversion: 2.1 time: 0.161192 Jul 30 16:16:58.029161 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 640/1293] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:57 2021] GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:58.048416 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-459e05d7-3e95-4955-8e4f-065e3ff2a4f2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:58.049659 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-459e05d7-3e95-4955-8e4f-065e3ff2a4f2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:58.055849 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-459e05d7-3e95-4955-8e4f-065e3ff2a4f2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:58.056207 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-459e05d7-3e95-4955-8e4f-065e3ff2a4f2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:58.056982 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-459e05d7-3e95-4955-8e4f-065e3ff2a4f2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:58.057415 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-459e05d7-3e95-4955-8e4f-065e3ff2a4f2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:58.186428 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-2f5a5fe3-7cc2-41ae-b9ca-44469a2fd863 req-bd5741d5-387b-46e7-aa91-def1fbbc4816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b2fe30-3bbe-4414-8cc3-6ac435a5288e", "tag": "097e775d-f23f-4ca8-a3e3-ef121c4f29d3"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:16:58.188033 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:16:58.188033 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:16:58.196652 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-2f5a5fe3-7cc2-41ae-b9ca-44469a2fd863 req-bd5741d5-387b-46e7-aa91-def1fbbc4816 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:58.197289 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-2f5a5fe3-7cc2-41ae-b9ca-44469a2fd863 req-bd5741d5-387b-46e7-aa91-def1fbbc4816 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:58.211954 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-2f5a5fe3-7cc2-41ae-b9ca-44469a2fd863 req-bd5741d5-387b-46e7-aa91-def1fbbc4816 service nova] Creating event network-changed:097e775d-f23f-4ca8-a3e3-ef121c4f29d3 for instance 00b2fe30-3bbe-4414-8cc3-6ac435a5288e on hv-cinder-80304 Jul 30 16:16:58.217136 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-2f5a5fe3-7cc2-41ae-b9ca-44469a2fd863 req-bd5741d5-387b-46e7-aa91-def1fbbc4816 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034275 Jul 30 16:16:58.218159 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 641/1294] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:16:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:16:58.296833 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-459e05d7-3e95-4955-8e4f-065e3ff2a4f2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:58.304249 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-459e05d7-3e95-4955-8e4f-065e3ff2a4f2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 200 len: 1267 microversion: 2.1 time: 0.259529 Jul 30 16:16:58.304821 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 654/1295] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:58 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:58.833021 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-17bc5b49-668e-469a-82eb-21e449e284ac req-06c49199-2170-47d1-b5ca-c094cf7bc4d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48ebdf43-59cd-4ddc-9f96-4f53f22016d7", "name": "network-vif-plugged", "status": "completed", "tag": "5139c3f3-d435-4911-a997-6eb9f2353572"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:16:58.834963 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:16:58.834963 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:16:58.842822 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-17bc5b49-668e-469a-82eb-21e449e284ac req-06c49199-2170-47d1-b5ca-c094cf7bc4d8 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:58.843427 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-17bc5b49-668e-469a-82eb-21e449e284ac req-06c49199-2170-47d1-b5ca-c094cf7bc4d8 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:58.855385 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-17bc5b49-668e-469a-82eb-21e449e284ac req-06c49199-2170-47d1-b5ca-c094cf7bc4d8 service nova] Creating event network-vif-plugged:5139c3f3-d435-4911-a997-6eb9f2353572 for instance 48ebdf43-59cd-4ddc-9f96-4f53f22016d7 on hv-cinder-80304 Jul 30 16:16:58.860414 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-17bc5b49-668e-469a-82eb-21e449e284ac req-06c49199-2170-47d1-b5ca-c094cf7bc4d8 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031258 Jul 30 16:16:58.861023 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 642/1296] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:16:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:16:59.038027 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-c10f9c68-71fe-46ae-a6e0-7020c5f802a8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:59.038645 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-c10f9c68-71fe-46ae-a6e0-7020c5f802a8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 48ebdf43-59cd-4ddc-9f96-4f53f22016d7] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:59.044813 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c10f9c68-71fe-46ae-a6e0-7020c5f802a8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:59.045284 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c10f9c68-71fe-46ae-a6e0-7020c5f802a8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:59.046059 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c10f9c68-71fe-46ae-a6e0-7020c5f802a8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:59.046496 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-c10f9c68-71fe-46ae-a6e0-7020c5f802a8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:59.212262 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-c10f9c68-71fe-46ae-a6e0-7020c5f802a8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:59.219399 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-c10f9c68-71fe-46ae-a6e0-7020c5f802a8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7" status: 200 len: 1313 microversion: 2.1 time: 0.185936 Jul 30 16:16:59.219955 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 655/1297] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:59 2021] GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:16:59.322433 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d4106b50-2be5-4965-9120-46991e083a65 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:16:59.323074 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d4106b50-2be5-4965-9120-46991e083a65 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:16:59.329316 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d4106b50-2be5-4965-9120-46991e083a65 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:59.329773 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d4106b50-2be5-4965-9120-46991e083a65 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:59.330546 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d4106b50-2be5-4965-9120-46991e083a65 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:16:59.330981 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d4106b50-2be5-4965-9120-46991e083a65 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:16:59.452367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d4106b50-2be5-4965-9120-46991e083a65 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:16:59.459712 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d4106b50-2be5-4965-9120-46991e083a65 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 200 len: 1267 microversion: 2.1 time: 0.141559 Jul 30 16:16:59.460276 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 643/1298] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:16:59 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:00.235869 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-3645e089-4c88-47c4-909f-1d119b51421d tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:00.236476 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-3645e089-4c88-47c4-909f-1d119b51421d tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 48ebdf43-59cd-4ddc-9f96-4f53f22016d7] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:00.242267 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3645e089-4c88-47c4-909f-1d119b51421d tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:00.242714 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3645e089-4c88-47c4-909f-1d119b51421d tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:00.243497 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3645e089-4c88-47c4-909f-1d119b51421d tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:00.243931 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-3645e089-4c88-47c4-909f-1d119b51421d tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:00.361030 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-3645e089-4c88-47c4-909f-1d119b51421d tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:00.368194 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-3645e089-4c88-47c4-909f-1d119b51421d tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7" status: 200 len: 1496 microversion: 2.1 time: 0.136038 Jul 30 16:17:00.368743 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 656/1299] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:00 2021] GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7 => generated 1496 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:00.477528 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-0ac7810b-76c6-46ea-9bd0-379e6c4b0183 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:00.478139 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-0ac7810b-76c6-46ea-9bd0-379e6c4b0183 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:00.484003 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0ac7810b-76c6-46ea-9bd0-379e6c4b0183 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:00.484445 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0ac7810b-76c6-46ea-9bd0-379e6c4b0183 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:00.485197 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0ac7810b-76c6-46ea-9bd0-379e6c4b0183 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:00.485620 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-0ac7810b-76c6-46ea-9bd0-379e6c4b0183 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:00.607073 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-0ac7810b-76c6-46ea-9bd0-379e6c4b0183 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:00.614624 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-0ac7810b-76c6-46ea-9bd0-379e6c4b0183 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 200 len: 1267 microversion: 2.1 time: 0.140970 Jul 30 16:17:00.615220 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 644/1300] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:00 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:00.818127 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-b057a977-137d-4f3f-80a8-0164eff88ec8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:00.818621 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b057a977-137d-4f3f-80a8-0164eff88ec8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 48ebdf43-59cd-4ddc-9f96-4f53f22016d7] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:00.824330 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b057a977-137d-4f3f-80a8-0164eff88ec8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:00.824777 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b057a977-137d-4f3f-80a8-0164eff88ec8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:00.825539 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b057a977-137d-4f3f-80a8-0164eff88ec8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:00.825970 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-b057a977-137d-4f3f-80a8-0164eff88ec8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:00.851254 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-b057a977-137d-4f3f-80a8-0164eff88ec8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 48ebdf43-59cd-4ddc-9f96-4f53f22016d7] Going to try to terminate instance {{(pid=107452) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:17:00.922616 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-b057a977-137d-4f3f-80a8-0164eff88ec8 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "DELETE /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7" status: 204 len: 0 microversion: 2.1 time: 0.108418 Jul 30 16:17:00.923228 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 657/1301] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:17:00 2021] DELETE /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 16:17:00.932041 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4d2b1c10-2e47-4ef4-9f0f-5665d295be50 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:00.932648 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4d2b1c10-2e47-4ef4-9f0f-5665d295be50 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 48ebdf43-59cd-4ddc-9f96-4f53f22016d7] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:00.938343 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4d2b1c10-2e47-4ef4-9f0f-5665d295be50 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:00.938788 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4d2b1c10-2e47-4ef4-9f0f-5665d295be50 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:00.939576 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4d2b1c10-2e47-4ef4-9f0f-5665d295be50 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:00.940003 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4d2b1c10-2e47-4ef4-9f0f-5665d295be50 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:01.062283 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4d2b1c10-2e47-4ef4-9f0f-5665d295be50 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:01.072802 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4d2b1c10-2e47-4ef4-9f0f-5665d295be50 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7" status: 200 len: 1502 microversion: 2.1 time: 0.144607 Jul 30 16:17:01.073534 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 645/1302] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:00 2021] GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7 => generated 1502 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:01.631812 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-1537171f-8ea9-400c-8a23-9b0eac1fdca0 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:01.632404 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-1537171f-8ea9-400c-8a23-9b0eac1fdca0 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:01.638389 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1537171f-8ea9-400c-8a23-9b0eac1fdca0 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:01.638867 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1537171f-8ea9-400c-8a23-9b0eac1fdca0 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:01.639676 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1537171f-8ea9-400c-8a23-9b0eac1fdca0 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:01.640112 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-1537171f-8ea9-400c-8a23-9b0eac1fdca0 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:01.759125 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-1537171f-8ea9-400c-8a23-9b0eac1fdca0 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:01.766316 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-1537171f-8ea9-400c-8a23-9b0eac1fdca0 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 200 len: 1267 microversion: 2.1 time: 0.138636 Jul 30 16:17:01.775351 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 658/1303] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:01 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:02.092244 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2d0b4d95-064d-4acf-bce6-d4cce91f3fcb tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:02.092783 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-2d0b4d95-064d-4acf-bce6-d4cce91f3fcb tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 48ebdf43-59cd-4ddc-9f96-4f53f22016d7] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:02.098862 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2d0b4d95-064d-4acf-bce6-d4cce91f3fcb tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:02.099368 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2d0b4d95-064d-4acf-bce6-d4cce91f3fcb tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:02.100137 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2d0b4d95-064d-4acf-bce6-d4cce91f3fcb tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:02.100575 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2d0b4d95-064d-4acf-bce6-d4cce91f3fcb tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:02.217956 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-2d0b4d95-064d-4acf-bce6-d4cce91f3fcb tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:02.225264 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2d0b4d95-064d-4acf-bce6-d4cce91f3fcb tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7" status: 200 len: 1502 microversion: 2.1 time: 0.136814 Jul 30 16:17:02.225838 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 646/1304] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:02 2021] GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7 => generated 1502 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:02.784016 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-31fee1f1-2de7-47fd-8217-c9f5944b25af tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:02.784634 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-31fee1f1-2de7-47fd-8217-c9f5944b25af tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:02.790597 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-31fee1f1-2de7-47fd-8217-c9f5944b25af tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:02.791046 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-31fee1f1-2de7-47fd-8217-c9f5944b25af tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:02.791852 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-31fee1f1-2de7-47fd-8217-c9f5944b25af tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:02.792290 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-31fee1f1-2de7-47fd-8217-c9f5944b25af tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:02.972868 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-31fee1f1-2de7-47fd-8217-c9f5944b25af tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:02.980198 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-31fee1f1-2de7-47fd-8217-c9f5944b25af tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 200 len: 1267 microversion: 2.1 time: 0.199861 Jul 30 16:17:02.980760 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 659/1305] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:02 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:03.218587 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-9c3267bb-768c-41c7-9757-b3943237682c req-70c85394-f409-441b-bd3f-3da5ba6bb3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48ebdf43-59cd-4ddc-9f96-4f53f22016d7", "name": "network-vif-deleted", "tag": "5139c3f3-d435-4911-a997-6eb9f2353572"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:17:03.220127 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:17:03.220127 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:17:03.226978 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-9c3267bb-768c-41c7-9757-b3943237682c req-70c85394-f409-441b-bd3f-3da5ba6bb3e4 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:03.227459 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-9c3267bb-768c-41c7-9757-b3943237682c req-70c85394-f409-441b-bd3f-3da5ba6bb3e4 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:03.239909 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-9c3267bb-768c-41c7-9757-b3943237682c req-70c85394-f409-441b-bd3f-3da5ba6bb3e4 service nova] Creating event network-vif-deleted:5139c3f3-d435-4911-a997-6eb9f2353572 for instance 48ebdf43-59cd-4ddc-9f96-4f53f22016d7 on hv-cinder-80304 Jul 30 16:17:03.242643 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-76434f9d-dd1f-4b49-9308-9ff3d937ac2f tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:03.243290 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-76434f9d-dd1f-4b49-9308-9ff3d937ac2f tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 48ebdf43-59cd-4ddc-9f96-4f53f22016d7] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:03.246392 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-9c3267bb-768c-41c7-9757-b3943237682c req-70c85394-f409-441b-bd3f-3da5ba6bb3e4 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031424 Jul 30 16:17:03.247032 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 647/1306] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:17:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:17:03.249227 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-76434f9d-dd1f-4b49-9308-9ff3d937ac2f tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:03.249733 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-76434f9d-dd1f-4b49-9308-9ff3d937ac2f tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:03.250478 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-76434f9d-dd1f-4b49-9308-9ff3d937ac2f tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:03.250929 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-76434f9d-dd1f-4b49-9308-9ff3d937ac2f tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:03.313564 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-76434f9d-dd1f-4b49-9308-9ff3d937ac2f tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74cdab32b87476998702e08bd60fc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ee051b3b5e4e9ba39b5b3a11792eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:03.321551 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-76434f9d-dd1f-4b49-9308-9ff3d937ac2f tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7" status: 200 len: 1298 microversion: 2.1 time: 0.083342 Jul 30 16:17:03.322314 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 660/1307] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:03 2021] GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:03.996575 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e2515d48-1f46-4d6b-9ff5-e0e423345789 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:03.997276 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e2515d48-1f46-4d6b-9ff5-e0e423345789 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:04.003427 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e2515d48-1f46-4d6b-9ff5-e0e423345789 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:04.003883 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e2515d48-1f46-4d6b-9ff5-e0e423345789 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:04.004711 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e2515d48-1f46-4d6b-9ff5-e0e423345789 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:04.005199 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e2515d48-1f46-4d6b-9ff5-e0e423345789 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:04.124262 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e2515d48-1f46-4d6b-9ff5-e0e423345789 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:04.131760 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e2515d48-1f46-4d6b-9ff5-e0e423345789 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 200 len: 1267 microversion: 2.1 time: 0.139196 Jul 30 16:17:04.132315 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 648/1308] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:03 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:04.338652 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-bf6f4b16-8383-4bd7-ab05-fb5c83f1e8a5 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:04.339230 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-bf6f4b16-8383-4bd7-ab05-fb5c83f1e8a5 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] [instance: 48ebdf43-59cd-4ddc-9f96-4f53f22016d7] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:04.345080 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bf6f4b16-8383-4bd7-ab05-fb5c83f1e8a5 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:04.345516 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bf6f4b16-8383-4bd7-ab05-fb5c83f1e8a5 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:04.346262 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bf6f4b16-8383-4bd7-ab05-fb5c83f1e8a5 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:04.346689 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-bf6f4b16-8383-4bd7-ab05-fb5c83f1e8a5 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:04.359460 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-bf6f4b16-8383-4bd7-ab05-fb5c83f1e8a5 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] HTTP exception thrown: Instance 48ebdf43-59cd-4ddc-9f96-4f53f22016d7 could not be found. Jul 30 16:17:04.360029 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-bf6f4b16-8383-4bd7-ab05-fb5c83f1e8a5 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] Returning 404 to user: Instance 48ebdf43-59cd-4ddc-9f96-4f53f22016d7 could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:17:04.360825 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-bf6f4b16-8383-4bd7-ab05-fb5c83f1e8a5 tempest-VolumesActionsTest-279635421 tempest-VolumesActionsTest-279635421-project] 10.222.0.37 "GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7" status: 404 len: 111 microversion: 2.1 time: 0.025927 Jul 30 16:17:04.361323 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 661/1309] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:04 2021] GET /compute/v2.1/servers/48ebdf43-59cd-4ddc-9f96-4f53f22016d7 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:17:05.148631 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a14759fc-3a40-4377-9147-b6bc5d02a9ef tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:05.149436 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a14759fc-3a40-4377-9147-b6bc5d02a9ef tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:05.155290 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a14759fc-3a40-4377-9147-b6bc5d02a9ef tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:05.155750 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a14759fc-3a40-4377-9147-b6bc5d02a9ef tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:05.156757 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a14759fc-3a40-4377-9147-b6bc5d02a9ef tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:05.157201 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a14759fc-3a40-4377-9147-b6bc5d02a9ef tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:05.281000 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a14759fc-3a40-4377-9147-b6bc5d02a9ef tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:05.289431 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a14759fc-3a40-4377-9147-b6bc5d02a9ef tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 200 len: 1267 microversion: 2.1 time: 0.145116 Jul 30 16:17:05.289991 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 649/1310] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:05 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:06.306336 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-39ce4722-a114-4582-a5ab-7cbadedc0fcf tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:06.306953 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-39ce4722-a114-4582-a5ab-7cbadedc0fcf tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:06.312755 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-39ce4722-a114-4582-a5ab-7cbadedc0fcf tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:06.313205 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-39ce4722-a114-4582-a5ab-7cbadedc0fcf tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:06.313973 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-39ce4722-a114-4582-a5ab-7cbadedc0fcf tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:06.314407 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-39ce4722-a114-4582-a5ab-7cbadedc0fcf tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:06.431116 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-39ce4722-a114-4582-a5ab-7cbadedc0fcf tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:06.438282 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-39ce4722-a114-4582-a5ab-7cbadedc0fcf tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 200 len: 1267 microversion: 2.1 time: 0.135719 Jul 30 16:17:06.438834 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 662/1311] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:06 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:07.454911 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-46bb1353-607b-4f6f-b882-7f6bb973906c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:07.455544 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-46bb1353-607b-4f6f-b882-7f6bb973906c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:07.461438 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-46bb1353-607b-4f6f-b882-7f6bb973906c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:07.461885 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-46bb1353-607b-4f6f-b882-7f6bb973906c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:07.462646 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-46bb1353-607b-4f6f-b882-7f6bb973906c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:07.463077 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-46bb1353-607b-4f6f-b882-7f6bb973906c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:07.580666 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-46bb1353-607b-4f6f-b882-7f6bb973906c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:07.587926 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-46bb1353-607b-4f6f-b882-7f6bb973906c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 200 len: 1267 microversion: 2.1 time: 0.136733 Jul 30 16:17:07.588488 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 650/1312] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:07 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:08.604246 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-2acc48e5-4bd1-44ef-a693-2ed9e9f0b920 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:08.604846 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-2acc48e5-4bd1-44ef-a693-2ed9e9f0b920 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:08.610469 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2acc48e5-4bd1-44ef-a693-2ed9e9f0b920 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:08.610912 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2acc48e5-4bd1-44ef-a693-2ed9e9f0b920 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:08.611729 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2acc48e5-4bd1-44ef-a693-2ed9e9f0b920 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:08.612155 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2acc48e5-4bd1-44ef-a693-2ed9e9f0b920 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:08.735304 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-2acc48e5-4bd1-44ef-a693-2ed9e9f0b920 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:08.743188 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-2acc48e5-4bd1-44ef-a693-2ed9e9f0b920 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 200 len: 1267 microversion: 2.1 time: 0.142964 Jul 30 16:17:08.743967 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 663/1313] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:08 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:09.760628 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2f3470b6-2a68-463e-9e4d-7c5eff819748 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:09.761952 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-2f3470b6-2a68-463e-9e4d-7c5eff819748 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:09.772690 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2f3470b6-2a68-463e-9e4d-7c5eff819748 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:09.773429 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2f3470b6-2a68-463e-9e4d-7c5eff819748 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:09.774988 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2f3470b6-2a68-463e-9e4d-7c5eff819748 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:09.775855 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2f3470b6-2a68-463e-9e4d-7c5eff819748 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:09.941080 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-2f3470b6-2a68-463e-9e4d-7c5eff819748 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:09.949540 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2f3470b6-2a68-463e-9e4d-7c5eff819748 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 200 len: 1267 microversion: 2.1 time: 0.192479 Jul 30 16:17:09.950334 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 651/1314] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:09 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:17:10.905182 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-213f0508-aae7-4b13-ac10-dbfa6ed8dc2a req-32875025-f016-4341-954f-660ad6713a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b2fe30-3bbe-4414-8cc3-6ac435a5288e", "name": "network-vif-plugged", "status": "completed", "tag": "097e775d-f23f-4ca8-a3e3-ef121c4f29d3"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:17:10.909198 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:17:10.909198 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:17:10.930238 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-213f0508-aae7-4b13-ac10-dbfa6ed8dc2a req-32875025-f016-4341-954f-660ad6713a39 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:10.930683 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-213f0508-aae7-4b13-ac10-dbfa6ed8dc2a req-32875025-f016-4341-954f-660ad6713a39 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:10.954249 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-213f0508-aae7-4b13-ac10-dbfa6ed8dc2a req-32875025-f016-4341-954f-660ad6713a39 service nova] Creating event network-vif-plugged:097e775d-f23f-4ca8-a3e3-ef121c4f29d3 for instance 00b2fe30-3bbe-4414-8cc3-6ac435a5288e on hv-cinder-80304 Jul 30 16:17:10.959785 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-213f0508-aae7-4b13-ac10-dbfa6ed8dc2a req-32875025-f016-4341-954f-660ad6713a39 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060520 Jul 30 16:17:10.960401 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 664/1315] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:17:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:17:10.966300 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c3237694-1809-447a-b46f-4edca51978c2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:10.966930 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c3237694-1809-447a-b46f-4edca51978c2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:10.972905 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c3237694-1809-447a-b46f-4edca51978c2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:10.973367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c3237694-1809-447a-b46f-4edca51978c2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:10.974669 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c3237694-1809-447a-b46f-4edca51978c2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:10.975278 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c3237694-1809-447a-b46f-4edca51978c2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:11.135264 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c3237694-1809-447a-b46f-4edca51978c2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:11.145181 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c3237694-1809-447a-b46f-4edca51978c2 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 200 len: 1267 microversion: 2.1 time: 0.182996 Jul 30 16:17:11.155273 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 652/1316] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:10 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:12.165501 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-e119b60c-ea9a-4793-81e3-3d62a3ee928c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:12.166331 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-e119b60c-ea9a-4793-81e3-3d62a3ee928c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:12.173210 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e119b60c-ea9a-4793-81e3-3d62a3ee928c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:12.173698 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e119b60c-ea9a-4793-81e3-3d62a3ee928c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:12.175026 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e119b60c-ea9a-4793-81e3-3d62a3ee928c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:12.175873 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-e119b60c-ea9a-4793-81e3-3d62a3ee928c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:12.345851 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-e119b60c-ea9a-4793-81e3-3d62a3ee928c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:12.355070 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-e119b60c-ea9a-4793-81e3-3d62a3ee928c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 200 len: 1455 microversion: 2.1 time: 0.194173 Jul 30 16:17:12.355662 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 665/1317] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:12 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 1455 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:12.373503 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-58111acc-893c-42a4-ae22-01c61872b304 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:12.377556 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-58111acc-893c-42a4-ae22-01c61872b304 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:12.385680 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-58111acc-893c-42a4-ae22-01c61872b304 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:12.386609 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-58111acc-893c-42a4-ae22-01c61872b304 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:12.387856 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-58111acc-893c-42a4-ae22-01c61872b304 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:12.388428 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-58111acc-893c-42a4-ae22-01c61872b304 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:12.536574 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-58111acc-893c-42a4-ae22-01c61872b304 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:12.545125 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-58111acc-893c-42a4-ae22-01c61872b304 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 200 len: 1455 microversion: 2.1 time: 0.176552 Jul 30 16:17:12.546024 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 653/1318] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:12 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 1455 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:14.430639 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-777e4f64-8de7-47f4-b0d7-2419e267d2e5 req-e3b1facf-d21f-482f-9599-f2a428893023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b2fe30-3bbe-4414-8cc3-6ac435a5288e", "tag": "097e775d-f23f-4ca8-a3e3-ef121c4f29d3"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:17:14.433242 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:17:14.433242 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:17:14.444677 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-777e4f64-8de7-47f4-b0d7-2419e267d2e5 req-e3b1facf-d21f-482f-9599-f2a428893023 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:14.445277 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-777e4f64-8de7-47f4-b0d7-2419e267d2e5 req-e3b1facf-d21f-482f-9599-f2a428893023 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:14.459399 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-777e4f64-8de7-47f4-b0d7-2419e267d2e5 req-e3b1facf-d21f-482f-9599-f2a428893023 service nova] Creating event network-changed:097e775d-f23f-4ca8-a3e3-ef121c4f29d3 for instance 00b2fe30-3bbe-4414-8cc3-6ac435a5288e on hv-cinder-80304 Jul 30 16:17:14.466075 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-777e4f64-8de7-47f4-b0d7-2419e267d2e5 req-e3b1facf-d21f-482f-9599-f2a428893023 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038872 Jul 30 16:17:14.466702 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 666/1319] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:17:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:17:24.413930 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-6630050c-0db7-4ec0-a22f-a9c56f304f41 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:17:24.414462 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-6630050c-0db7-4ec0-a22f-a9c56f304f41 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:24.420228 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6630050c-0db7-4ec0-a22f-a9c56f304f41 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:24.420682 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6630050c-0db7-4ec0-a22f-a9c56f304f41 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:24.421448 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6630050c-0db7-4ec0-a22f-a9c56f304f41 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:24.421883 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6630050c-0db7-4ec0-a22f-a9c56f304f41 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:24.443629 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.objects.instance [None req-6630050c-0db7-4ec0-a22f-a9c56f304f41 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lazy-loading 'flavor' on Instance uuid d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a {{(pid=107453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:17:24.514324 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-6630050c-0db7-4ec0-a22f-a9c56f304f41 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "POST /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a/action" status: 202 len: 0 microversion: 2.1 time: 0.104707 Jul 30 16:17:24.514897 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 654/1320] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:17:24 2021] POST /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:17:24.525417 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0de271b8-7695-4ec1-8608-27c9b4a1cf91 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:24.526254 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0de271b8-7695-4ec1-8608-27c9b4a1cf91 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:24.532666 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0de271b8-7695-4ec1-8608-27c9b4a1cf91 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:24.533265 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0de271b8-7695-4ec1-8608-27c9b4a1cf91 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:24.534254 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0de271b8-7695-4ec1-8608-27c9b4a1cf91 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:24.535397 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0de271b8-7695-4ec1-8608-27c9b4a1cf91 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:24.661960 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0de271b8-7695-4ec1-8608-27c9b4a1cf91 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:24.669447 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0de271b8-7695-4ec1-8608-27c9b4a1cf91 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1568 microversion: 2.1 time: 0.149848 Jul 30 16:17:24.669932 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 667/1321] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:24 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:25.732331 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-fc3b2bbf-06e9-4221-8fe1-54112333a541 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:25.733042 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-fc3b2bbf-06e9-4221-8fe1-54112333a541 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:25.738964 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fc3b2bbf-06e9-4221-8fe1-54112333a541 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:25.739447 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fc3b2bbf-06e9-4221-8fe1-54112333a541 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:25.740740 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fc3b2bbf-06e9-4221-8fe1-54112333a541 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:25.741408 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-fc3b2bbf-06e9-4221-8fe1-54112333a541 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:25.863590 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-fc3b2bbf-06e9-4221-8fe1-54112333a541 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:25.871120 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-fc3b2bbf-06e9-4221-8fe1-54112333a541 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1568 microversion: 2.1 time: 0.142845 Jul 30 16:17:25.871793 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 655/1322] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:25 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:26.888369 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-91097aa8-8a4a-462b-bf9b-e33e4594060b tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:26.888951 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-91097aa8-8a4a-462b-bf9b-e33e4594060b tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:26.895635 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-91097aa8-8a4a-462b-bf9b-e33e4594060b tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:26.896086 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-91097aa8-8a4a-462b-bf9b-e33e4594060b tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:26.896849 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-91097aa8-8a4a-462b-bf9b-e33e4594060b tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:26.898071 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-91097aa8-8a4a-462b-bf9b-e33e4594060b tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:27.023396 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-91097aa8-8a4a-462b-bf9b-e33e4594060b tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:27.031905 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-91097aa8-8a4a-462b-bf9b-e33e4594060b tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1568 microversion: 2.1 time: 0.147150 Jul 30 16:17:27.032470 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 668/1323] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:26 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:28.048232 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-931def21-7152-488f-809f-cb6180f53b62 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:28.048892 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-931def21-7152-488f-809f-cb6180f53b62 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:28.054722 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-931def21-7152-488f-809f-cb6180f53b62 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:28.055201 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-931def21-7152-488f-809f-cb6180f53b62 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:28.055968 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-931def21-7152-488f-809f-cb6180f53b62 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:28.056400 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-931def21-7152-488f-809f-cb6180f53b62 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:28.187974 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-931def21-7152-488f-809f-cb6180f53b62 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:28.195973 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-931def21-7152-488f-809f-cb6180f53b62 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1568 microversion: 2.1 time: 0.151350 Jul 30 16:17:28.196528 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 656/1324] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:28 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:29.212991 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-afd38352-7bbe-4458-bfd0-8d31dd0f144b tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:29.213639 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-afd38352-7bbe-4458-bfd0-8d31dd0f144b tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:29.219389 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-afd38352-7bbe-4458-bfd0-8d31dd0f144b tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:29.219842 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-afd38352-7bbe-4458-bfd0-8d31dd0f144b tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:29.220614 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-afd38352-7bbe-4458-bfd0-8d31dd0f144b tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:29.221059 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-afd38352-7bbe-4458-bfd0-8d31dd0f144b tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:29.347366 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-afd38352-7bbe-4458-bfd0-8d31dd0f144b tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:29.355869 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-afd38352-7bbe-4458-bfd0-8d31dd0f144b tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1568 microversion: 2.1 time: 0.147086 Jul 30 16:17:29.356446 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 669/1325] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:29 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:30.372797 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-2017ba37-0b5a-4867-8109-40df6a30e502 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:30.373411 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-2017ba37-0b5a-4867-8109-40df6a30e502 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:30.379422 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2017ba37-0b5a-4867-8109-40df6a30e502 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:30.379873 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2017ba37-0b5a-4867-8109-40df6a30e502 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:30.380644 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2017ba37-0b5a-4867-8109-40df6a30e502 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:30.381076 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-2017ba37-0b5a-4867-8109-40df6a30e502 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:30.502541 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-2017ba37-0b5a-4867-8109-40df6a30e502 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:30.510336 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-2017ba37-0b5a-4867-8109-40df6a30e502 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1568 microversion: 2.1 time: 0.141252 Jul 30 16:17:30.510894 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 657/1326] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:30 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:31.528363 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f17f1aac-3692-46eb-97e0-cc863b407868 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:31.528976 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f17f1aac-3692-46eb-97e0-cc863b407868 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:31.534882 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f17f1aac-3692-46eb-97e0-cc863b407868 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:31.535377 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f17f1aac-3692-46eb-97e0-cc863b407868 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:31.536145 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f17f1aac-3692-46eb-97e0-cc863b407868 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:31.536577 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f17f1aac-3692-46eb-97e0-cc863b407868 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:31.656417 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f17f1aac-3692-46eb-97e0-cc863b407868 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:31.663703 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f17f1aac-3692-46eb-97e0-cc863b407868 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1568 microversion: 2.1 time: 0.139319 Jul 30 16:17:31.664258 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 670/1327] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:31 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:32.680733 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-9db8089b-e1db-4340-9669-2326b917d8a5 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:32.681336 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-9db8089b-e1db-4340-9669-2326b917d8a5 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:32.687275 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9db8089b-e1db-4340-9669-2326b917d8a5 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:32.687729 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9db8089b-e1db-4340-9669-2326b917d8a5 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:32.688493 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9db8089b-e1db-4340-9669-2326b917d8a5 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:32.688927 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-9db8089b-e1db-4340-9669-2326b917d8a5 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:32.807698 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-9db8089b-e1db-4340-9669-2326b917d8a5 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:32.814933 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-9db8089b-e1db-4340-9669-2326b917d8a5 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1568 microversion: 2.1 time: 0.138256 Jul 30 16:17:32.815531 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 658/1328] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:32 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:33.832304 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-6ca750da-23b6-4f7e-aba6-b0e731b92712 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:33.832900 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-6ca750da-23b6-4f7e-aba6-b0e731b92712 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:33.839306 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6ca750da-23b6-4f7e-aba6-b0e731b92712 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:33.839762 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6ca750da-23b6-4f7e-aba6-b0e731b92712 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:33.840536 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6ca750da-23b6-4f7e-aba6-b0e731b92712 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:33.840973 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-6ca750da-23b6-4f7e-aba6-b0e731b92712 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:33.959042 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-6ca750da-23b6-4f7e-aba6-b0e731b92712 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:33.966972 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-6ca750da-23b6-4f7e-aba6-b0e731b92712 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1568 microversion: 2.1 time: 0.138435 Jul 30 16:17:33.967581 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 671/1329] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:33 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:34.984088 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8c980566-56ae-4f52-9e99-33304e23f2d2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:34.984690 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-8c980566-56ae-4f52-9e99-33304e23f2d2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:34.990414 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8c980566-56ae-4f52-9e99-33304e23f2d2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:34.990852 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8c980566-56ae-4f52-9e99-33304e23f2d2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:34.992413 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8c980566-56ae-4f52-9e99-33304e23f2d2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:34.992990 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8c980566-56ae-4f52-9e99-33304e23f2d2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:35.112739 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-8c980566-56ae-4f52-9e99-33304e23f2d2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:35.120867 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8c980566-56ae-4f52-9e99-33304e23f2d2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1568 microversion: 2.1 time: 0.140427 Jul 30 16:17:35.121442 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 659/1330] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:34 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:36.138111 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-f266cc33-39e5-40fd-8981-0ee1e5e04079 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:36.138640 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-f266cc33-39e5-40fd-8981-0ee1e5e04079 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:36.144592 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f266cc33-39e5-40fd-8981-0ee1e5e04079 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:36.145043 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f266cc33-39e5-40fd-8981-0ee1e5e04079 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:36.145809 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f266cc33-39e5-40fd-8981-0ee1e5e04079 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:36.146243 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-f266cc33-39e5-40fd-8981-0ee1e5e04079 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:36.262539 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-f266cc33-39e5-40fd-8981-0ee1e5e04079 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:36.270024 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-f266cc33-39e5-40fd-8981-0ee1e5e04079 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1568 microversion: 2.1 time: 0.135693 Jul 30 16:17:36.270589 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 672/1331] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:36 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:37.287044 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-6c219933-3fa9-43e1-bbce-7272ffcb2755 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:37.287732 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-6c219933-3fa9-43e1-bbce-7272ffcb2755 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:37.294139 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6c219933-3fa9-43e1-bbce-7272ffcb2755 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:37.294284 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6c219933-3fa9-43e1-bbce-7272ffcb2755 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:37.295102 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6c219933-3fa9-43e1-bbce-7272ffcb2755 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:37.295571 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-6c219933-3fa9-43e1-bbce-7272ffcb2755 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:37.424645 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-6c219933-3fa9-43e1-bbce-7272ffcb2755 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:37.432855 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-6c219933-3fa9-43e1-bbce-7272ffcb2755 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1568 microversion: 2.1 time: 0.149397 Jul 30 16:17:37.433456 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 660/1332] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:37 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:38.449730 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-7355de86-08d3-415b-aa0d-aa13e6a85433 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:38.450337 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7355de86-08d3-415b-aa0d-aa13e6a85433 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:38.456221 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7355de86-08d3-415b-aa0d-aa13e6a85433 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:38.456673 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7355de86-08d3-415b-aa0d-aa13e6a85433 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:38.457438 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7355de86-08d3-415b-aa0d-aa13e6a85433 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:38.457882 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7355de86-08d3-415b-aa0d-aa13e6a85433 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:38.574878 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-7355de86-08d3-415b-aa0d-aa13e6a85433 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:38.582069 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-7355de86-08d3-415b-aa0d-aa13e6a85433 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1509 microversion: 2.1 time: 0.136055 Jul 30 16:17:38.582627 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 673/1333] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:38 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1509 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:17:38.598401 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4dc729f6-2ae3-4087-a00e-62bf005d751e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:17:38.598976 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4dc729f6-2ae3-4087-a00e-62bf005d751e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:38.605799 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4dc729f6-2ae3-4087-a00e-62bf005d751e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:38.606248 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4dc729f6-2ae3-4087-a00e-62bf005d751e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:38.607017 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4dc729f6-2ae3-4087-a00e-62bf005d751e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:38.607485 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4dc729f6-2ae3-4087-a00e-62bf005d751e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:38.679109 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4dc729f6-2ae3-4087-a00e-62bf005d751e tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "POST /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a/action" status: 202 len: 0 microversion: 2.1 time: 0.084347 Jul 30 16:17:38.679748 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 661/1334] 10.222.0.37 () {60 vars in 1278 bytes} [Fri Jul 30 16:17:38 2021] POST /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:17:38.687508 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0511c632-b7f0-4acb-9ea3-f939ac37e7d9 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:38.688116 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0511c632-b7f0-4acb-9ea3-f939ac37e7d9 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:38.693997 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0511c632-b7f0-4acb-9ea3-f939ac37e7d9 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:38.694979 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0511c632-b7f0-4acb-9ea3-f939ac37e7d9 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:38.695784 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0511c632-b7f0-4acb-9ea3-f939ac37e7d9 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:38.696219 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0511c632-b7f0-4acb-9ea3-f939ac37e7d9 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:38.824986 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0511c632-b7f0-4acb-9ea3-f939ac37e7d9 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:38.834754 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0511c632-b7f0-4acb-9ea3-f939ac37e7d9 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1517 microversion: 2.1 time: 0.150810 Jul 30 16:17:38.836019 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 674/1335] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:38 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:39.851775 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-79c722bb-7d06-4ebf-8ca6-602953352d43 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:39.852395 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-79c722bb-7d06-4ebf-8ca6-602953352d43 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:39.858241 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-79c722bb-7d06-4ebf-8ca6-602953352d43 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:39.858693 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-79c722bb-7d06-4ebf-8ca6-602953352d43 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:39.859508 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-79c722bb-7d06-4ebf-8ca6-602953352d43 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:39.859949 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-79c722bb-7d06-4ebf-8ca6-602953352d43 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:39.978499 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-79c722bb-7d06-4ebf-8ca6-602953352d43 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:39.985813 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-79c722bb-7d06-4ebf-8ca6-602953352d43 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1575 microversion: 2.1 time: 0.137898 Jul 30 16:17:39.986373 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 662/1336] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:39 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1575 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:40.917643 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-5897b84f-e7c4-4358-9478-e7de2a3e9608 req-be365ce8-5944-40fb-a93b-0e46b9feadc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a", "name": "network-vif-unplugged", "status": "completed", "tag": "aeca0f4b-877a-4418-be7e-80555a5d3358"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:17:40.919541 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:17:40.919541 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:17:40.927251 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-5897b84f-e7c4-4358-9478-e7de2a3e9608 req-be365ce8-5944-40fb-a93b-0e46b9feadc0 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:40.928025 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-5897b84f-e7c4-4358-9478-e7de2a3e9608 req-be365ce8-5944-40fb-a93b-0e46b9feadc0 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:40.939065 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-5897b84f-e7c4-4358-9478-e7de2a3e9608 req-be365ce8-5944-40fb-a93b-0e46b9feadc0 service nova] Creating event network-vif-unplugged:aeca0f4b-877a-4418-be7e-80555a5d3358 for instance d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a on hv-cinder-80304 Jul 30 16:17:40.943857 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-5897b84f-e7c4-4358-9478-e7de2a3e9608 req-be365ce8-5944-40fb-a93b-0e46b9feadc0 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031292 Jul 30 16:17:40.944956 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 675/1337] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:17:40 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:17:41.003098 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-623a9799-c129-4e31-a597-6fc372fa4544 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:41.003746 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-623a9799-c129-4e31-a597-6fc372fa4544 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:41.010117 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-623a9799-c129-4e31-a597-6fc372fa4544 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:41.010570 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-623a9799-c129-4e31-a597-6fc372fa4544 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:41.011379 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-623a9799-c129-4e31-a597-6fc372fa4544 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:41.011819 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-623a9799-c129-4e31-a597-6fc372fa4544 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:41.130291 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-623a9799-c129-4e31-a597-6fc372fa4544 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:41.138224 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-623a9799-c129-4e31-a597-6fc372fa4544 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1575 microversion: 2.1 time: 0.138758 Jul 30 16:17:41.138792 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 663/1338] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:40 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1575 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:42.157121 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-215de146-ce43-49b7-84fd-e43eecaf14ef tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:42.157730 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-215de146-ce43-49b7-84fd-e43eecaf14ef tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:42.164475 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-215de146-ce43-49b7-84fd-e43eecaf14ef tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:42.164920 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-215de146-ce43-49b7-84fd-e43eecaf14ef tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:42.165679 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-215de146-ce43-49b7-84fd-e43eecaf14ef tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:42.166108 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-215de146-ce43-49b7-84fd-e43eecaf14ef tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:42.283353 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-215de146-ce43-49b7-84fd-e43eecaf14ef tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:42.291376 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-215de146-ce43-49b7-84fd-e43eecaf14ef tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1575 microversion: 2.1 time: 0.138374 Jul 30 16:17:42.291945 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 676/1339] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:42 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1575 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:43.309060 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-859f1ffa-ccb9-491a-92ae-f90c3c400de2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:43.309671 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-859f1ffa-ccb9-491a-92ae-f90c3c400de2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:43.315397 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-859f1ffa-ccb9-491a-92ae-f90c3c400de2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:43.315852 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-859f1ffa-ccb9-491a-92ae-f90c3c400de2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:43.316617 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-859f1ffa-ccb9-491a-92ae-f90c3c400de2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:43.317052 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-859f1ffa-ccb9-491a-92ae-f90c3c400de2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:43.448602 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-859f1ffa-ccb9-491a-92ae-f90c3c400de2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:43.455839 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-859f1ffa-ccb9-491a-92ae-f90c3c400de2 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1575 microversion: 2.1 time: 0.150452 Jul 30 16:17:43.456403 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 664/1340] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:43 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:44.472569 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-01a2939b-bee4-4e41-94b3-1f0980e77f9d tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:44.473176 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-01a2939b-bee4-4e41-94b3-1f0980e77f9d tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:44.479627 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-01a2939b-bee4-4e41-94b3-1f0980e77f9d tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:44.480076 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-01a2939b-bee4-4e41-94b3-1f0980e77f9d tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:44.480838 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-01a2939b-bee4-4e41-94b3-1f0980e77f9d tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:44.481271 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-01a2939b-bee4-4e41-94b3-1f0980e77f9d tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:44.597593 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-01a2939b-bee4-4e41-94b3-1f0980e77f9d tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:44.604960 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-01a2939b-bee4-4e41-94b3-1f0980e77f9d tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1575 microversion: 2.1 time: 0.136032 Jul 30 16:17:44.605522 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 677/1341] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:44 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1575 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:45.621519 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e997413b-5a76-42e1-a969-9c99ed35d314 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:45.622059 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e997413b-5a76-42e1-a969-9c99ed35d314 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:45.627923 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e997413b-5a76-42e1-a969-9c99ed35d314 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:45.628386 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e997413b-5a76-42e1-a969-9c99ed35d314 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:45.629151 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e997413b-5a76-42e1-a969-9c99ed35d314 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:45.629607 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e997413b-5a76-42e1-a969-9c99ed35d314 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:45.752708 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e997413b-5a76-42e1-a969-9c99ed35d314 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:45.760586 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e997413b-5a76-42e1-a969-9c99ed35d314 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1575 microversion: 2.1 time: 0.142800 Jul 30 16:17:45.761144 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 665/1342] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:45 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1575 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:46.778404 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-2b4aa3a5-34d1-431e-87ac-c7483e2cf0e8 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:46.779208 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-2b4aa3a5-34d1-431e-87ac-c7483e2cf0e8 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:46.786923 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2b4aa3a5-34d1-431e-87ac-c7483e2cf0e8 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:46.787546 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2b4aa3a5-34d1-431e-87ac-c7483e2cf0e8 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:46.788610 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2b4aa3a5-34d1-431e-87ac-c7483e2cf0e8 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:46.789216 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-2b4aa3a5-34d1-431e-87ac-c7483e2cf0e8 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:46.925680 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-2b4aa3a5-34d1-431e-87ac-c7483e2cf0e8 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:46.934014 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-2b4aa3a5-34d1-431e-87ac-c7483e2cf0e8 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1575 microversion: 2.1 time: 0.159742 Jul 30 16:17:46.934581 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 678/1343] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:46 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:47.950751 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-251ae4ec-a9a8-40b2-b456-6b0da379df9f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:17:47.951402 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-251ae4ec-a9a8-40b2-b456-6b0da379df9f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:17:47.957266 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-251ae4ec-a9a8-40b2-b456-6b0da379df9f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:47.957714 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-251ae4ec-a9a8-40b2-b456-6b0da379df9f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:47.958476 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-251ae4ec-a9a8-40b2-b456-6b0da379df9f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:47.958907 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-251ae4ec-a9a8-40b2-b456-6b0da379df9f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:48.074826 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-251ae4ec-a9a8-40b2-b456-6b0da379df9f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:17:48.083159 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-251ae4ec-a9a8-40b2-b456-6b0da379df9f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1562 microversion: 2.1 time: 0.136014 Jul 30 16:17:48.083764 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 666/1344] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:17:47 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1562 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:17:51.027389 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-d65ae36b-f38a-4baf-af75-c5bf1d82f67e req-e0b797a3-8ab4-46d8-a844-2793324e814f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a", "name": "network-vif-plugged", "status": "completed", "tag": "aeca0f4b-877a-4418-be7e-80555a5d3358"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:17:51.029134 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:17:51.029134 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:17:51.035878 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-d65ae36b-f38a-4baf-af75-c5bf1d82f67e req-e0b797a3-8ab4-46d8-a844-2793324e814f service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:17:51.036317 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-d65ae36b-f38a-4baf-af75-c5bf1d82f67e req-e0b797a3-8ab4-46d8-a844-2793324e814f service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:17:51.047815 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-d65ae36b-f38a-4baf-af75-c5bf1d82f67e req-e0b797a3-8ab4-46d8-a844-2793324e814f service nova] Creating event network-vif-plugged:aeca0f4b-877a-4418-be7e-80555a5d3358 for instance d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a on hv-cinder-80304 Jul 30 16:17:51.052649 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-d65ae36b-f38a-4baf-af75-c5bf1d82f67e req-e0b797a3-8ab4-46d8-a844-2793324e814f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029869 Jul 30 16:17:51.053239 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 679/1345] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:17:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:18:38.265845 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 16:18:38.266419 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: Fri Jul 30 16:18:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 16:18:38.607070 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 16:18:38.607643 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: Fri Jul 30 16:18:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 16:18:58.607804 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-b7a04f32-a280-407c-ae1a-ceb5430a79c4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-194464894", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2065592267", "security_groups": [{"name": "tempest-secgroup-smoke-1585456609"}], "block_device_mapping_v2": [{"uuid": "b792c363-ab66-4fa3-bbfe-e4cb8c97cadf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7d0da8fd-0a56-4002-b0c2-d66355f139a4"}]}} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:18:58.715289 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.network.neutron [None req-b7a04f32-a280-407c-ae1a-ceb5430a79c4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] validate_networks() for [('7d0da8fd-0a56-4002-b0c2-d66355f139a4', None, None, None)] {{(pid=107453) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 30 16:18:59.079451 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-b7a04f32-a280-407c-ae1a-ceb5430a79c4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Flavor limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 16:18:59.079871 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-b7a04f32-a280-407c-ae1a-ceb5430a79c4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Image limits 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 16:18:59.080343 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-b7a04f32-a280-407c-ae1a-ceb5430a79c4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Flavor pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 16:18:59.080748 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-b7a04f32-a280-407c-ae1a-ceb5430a79c4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Image pref 0:0:0 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 16:18:59.081156 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.virt.hardware [None req-b7a04f32-a280-407c-ae1a-ceb5430a79c4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 16:18:59.090906 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b7a04f32-a280-407c-ae1a-ceb5430a79c4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:18:59.091395 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b7a04f32-a280-407c-ae1a-ceb5430a79c4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:18:59.092195 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b7a04f32-a280-407c-ae1a-ceb5430a79c4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:18:59.092620 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-b7a04f32-a280-407c-ae1a-ceb5430a79c4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:18:59.108656 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-b7a04f32-a280-407c-ae1a-ceb5430a79c4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Getting quotas for project 07bf3493a71648c895b14d999b3bfb1e. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 30 16:18:59.112548 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.quota [None req-b7a04f32-a280-407c-ae1a-ceb5430a79c4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Getting quotas for user ea3885b43f9a4d32aab4abebece046c8 and project 07bf3493a71648c895b14d999b3bfb1e. Resources: {'cores', 'instances', 'ram'} {{(pid=107453) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 30 16:18:59.171662 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b7a04f32-a280-407c-ae1a-ceb5430a79c4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Going to run 1 instances... {{(pid=107453) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 30 16:18:59.173809 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-b7a04f32-a280-407c-ae1a-ceb5430a79c4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b792c363-ab66-4fa3-bbfe-e4cb8c97cadf',volume_size=None,volume_type=None)] {{(pid=107453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 30 16:18:59.292639 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-b7a04f32-a280-407c-ae1a-ceb5430a79c4 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.689998 Jul 30 16:18:59.293997 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 667/1346] 10.222.0.37 () {60 vars in 1147 bytes} [Fri Jul 30 16:18:58 2021] POST /compute/v2.1/servers => generated 406 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 16:18:59.301523 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: ERROR oslo.messaging._drivers.impl_rabbit [-] [40fdf985-fc36-4349-83b0-0f9131163c01] AMQP server on 10.222.0.37:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 30 16:18:59.305379 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-7f769ff2-38c5-406a-b6cd-cf0a72ff1fa1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:18:59.306081 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7f769ff2-38c5-406a-b6cd-cf0a72ff1fa1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:18:59.358958 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-7f769ff2-38c5-406a-b6cd-cf0a72ff1fa1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:18:59.365584 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-7f769ff2-38c5-406a-b6cd-cf0a72ff1fa1 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8" status: 200 len: 1094 microversion: 2.1 time: 0.065922 Jul 30 16:18:59.366221 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 680/1347] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:18:59 2021] GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:19:00.382561 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bea196f8-9d79-48be-b862-b6e155969bf4] AMQP server on 10.222.0.37:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 30 16:19:00.386475 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-65f5fa6e-4d16-4e80-ad02-823912c1e1d9 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:19:00.387532 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-65f5fa6e-4d16-4e80-ad02-823912c1e1d9 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:19:00.393626 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-65f5fa6e-4d16-4e80-ad02-823912c1e1d9 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:00.394080 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-65f5fa6e-4d16-4e80-ad02-823912c1e1d9 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:00.394881 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-65f5fa6e-4d16-4e80-ad02-823912c1e1d9 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:00.395348 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-65f5fa6e-4d16-4e80-ad02-823912c1e1d9 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:00.463388 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-65f5fa6e-4d16-4e80-ad02-823912c1e1d9 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:19:00.471658 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-65f5fa6e-4d16-4e80-ad02-823912c1e1d9 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8" status: 200 len: 1210 microversion: 2.1 time: 0.090713 Jul 30 16:19:00.472267 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 668/1348] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:19:00 2021] GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:19:01.513763 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO oslo.messaging._drivers.impl_rabbit [-] [40fdf985-fc36-4349-83b0-0f9131163c01] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 56312. Jul 30 16:19:01.632116 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-cd9125cd-1c45-484a-ab1b-260310077cce tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:19:01.632756 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-cd9125cd-1c45-484a-ab1b-260310077cce tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:19:01.640280 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cd9125cd-1c45-484a-ab1b-260310077cce tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:01.640727 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cd9125cd-1c45-484a-ab1b-260310077cce tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:01.641502 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cd9125cd-1c45-484a-ab1b-260310077cce tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:01.641938 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-cd9125cd-1c45-484a-ab1b-260310077cce tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:01.689344 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO oslo.messaging._drivers.impl_rabbit [-] [bea196f8-9d79-48be-b862-b6e155969bf4] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 56318. Jul 30 16:19:01.748557 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-1e257f0f-b6f4-4769-b93b-71504618984c req-ac2e5764-35cf-401f-8981-c01c17643c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b57f0a67-c66f-4085-bb05-4361f5f783c8", "tag": "dc53c338-dfd0-433c-8622-0c4c81eba97d"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:19:01.750408 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:19:01.750408 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:19:01.758589 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-1e257f0f-b6f4-4769-b93b-71504618984c req-ac2e5764-35cf-401f-8981-c01c17643c4a service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:01.759479 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-1e257f0f-b6f4-4769-b93b-71504618984c req-ac2e5764-35cf-401f-8981-c01c17643c4a service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:01.771888 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-1e257f0f-b6f4-4769-b93b-71504618984c req-ac2e5764-35cf-401f-8981-c01c17643c4a service nova] Creating event network-changed:dc53c338-dfd0-433c-8622-0c4c81eba97d for instance b57f0a67-c66f-4085-bb05-4361f5f783c8 on hv-cinder-80304 Jul 30 16:19:01.777652 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-1e257f0f-b6f4-4769-b93b-71504618984c req-ac2e5764-35cf-401f-8981-c01c17643c4a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116073 Jul 30 16:19:01.778812 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 669/1349] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:19:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:19:01.898907 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-cd9125cd-1c45-484a-ab1b-260310077cce tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:19:01.906782 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-cd9125cd-1c45-484a-ab1b-260310077cce tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8" status: 200 len: 1266 microversion: 2.1 time: 0.421192 Jul 30 16:19:01.915776 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 681/1350] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:19:01 2021] GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8 => generated 1266 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:19:02.924139 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-d5a7c518-ed37-4f3a-b5bc-00af7052b63b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:19:02.924753 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-d5a7c518-ed37-4f3a-b5bc-00af7052b63b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:19:02.930860 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d5a7c518-ed37-4f3a-b5bc-00af7052b63b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:02.931349 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d5a7c518-ed37-4f3a-b5bc-00af7052b63b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:02.932146 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d5a7c518-ed37-4f3a-b5bc-00af7052b63b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:02.932591 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-d5a7c518-ed37-4f3a-b5bc-00af7052b63b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:03.055354 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-d5a7c518-ed37-4f3a-b5bc-00af7052b63b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:19:03.069447 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-d5a7c518-ed37-4f3a-b5bc-00af7052b63b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8" status: 200 len: 1266 microversion: 2.1 time: 0.143747 Jul 30 16:19:03.070014 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 670/1351] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:19:02 2021] GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:19:04.087331 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-df220be9-b06c-4db0-8453-7a774b595c5a tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:19:04.087955 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-df220be9-b06c-4db0-8453-7a774b595c5a tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:19:04.094353 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-df220be9-b06c-4db0-8453-7a774b595c5a tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:04.094804 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-df220be9-b06c-4db0-8453-7a774b595c5a tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:04.095610 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-df220be9-b06c-4db0-8453-7a774b595c5a tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:04.096049 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-df220be9-b06c-4db0-8453-7a774b595c5a tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:04.217957 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-df220be9-b06c-4db0-8453-7a774b595c5a tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:19:04.225196 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-df220be9-b06c-4db0-8453-7a774b595c5a tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8" status: 200 len: 1266 microversion: 2.1 time: 0.141852 Jul 30 16:19:04.225861 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 682/1352] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:19:04 2021] GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:19:05.241951 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f12e3961-5393-4831-82d9-4f3831900331 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:19:05.242725 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f12e3961-5393-4831-82d9-4f3831900331 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:19:05.248804 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f12e3961-5393-4831-82d9-4f3831900331 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:05.249254 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f12e3961-5393-4831-82d9-4f3831900331 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:05.250028 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f12e3961-5393-4831-82d9-4f3831900331 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:05.250460 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f12e3961-5393-4831-82d9-4f3831900331 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:05.370184 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f12e3961-5393-4831-82d9-4f3831900331 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:19:05.377444 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f12e3961-5393-4831-82d9-4f3831900331 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8" status: 200 len: 1266 microversion: 2.1 time: 0.139171 Jul 30 16:19:05.377997 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 671/1353] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:19:05 2021] GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:19:05.830005 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-18f1d24d-5d73-4d22-8965-0ff993834367 req-887675a6-de60-4488-8202-dc9ac425db88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a", "tag": "aeca0f4b-877a-4418-be7e-80555a5d3358"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:19:05.832965 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-7ee3add3-ea94-42c0-90ad-5964ea413ce3 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:19:05.834821 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:19:05.834821 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:19:05.835156 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7ee3add3-ea94-42c0-90ad-5964ea413ce3 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:19:05.842599 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7ee3add3-ea94-42c0-90ad-5964ea413ce3 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:05.842599 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7ee3add3-ea94-42c0-90ad-5964ea413ce3 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:05.842881 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-18f1d24d-5d73-4d22-8965-0ff993834367 req-887675a6-de60-4488-8202-dc9ac425db88 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:05.843355 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-18f1d24d-5d73-4d22-8965-0ff993834367 req-887675a6-de60-4488-8202-dc9ac425db88 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:05.843489 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7ee3add3-ea94-42c0-90ad-5964ea413ce3 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:05.843852 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-7ee3add3-ea94-42c0-90ad-5964ea413ce3 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:05.855036 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-18f1d24d-5d73-4d22-8965-0ff993834367 req-887675a6-de60-4488-8202-dc9ac425db88 service nova] Creating event network-changed:aeca0f4b-877a-4418-be7e-80555a5d3358 for instance d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a on hv-cinder-80304 Jul 30 16:19:05.860215 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-18f1d24d-5d73-4d22-8965-0ff993834367 req-887675a6-de60-4488-8202-dc9ac425db88 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033743 Jul 30 16:19:05.860814 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 672/1354] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:19:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 16:19:05.873188 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-7ee3add3-ea94-42c0-90ad-5964ea413ce3 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Going to try to terminate instance {{(pid=107452) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:19:05.959624 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-7ee3add3-ea94-42c0-90ad-5964ea413ce3 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "DELETE /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 204 len: 0 microversion: 2.1 time: 0.136525 Jul 30 16:19:05.960492 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 683/1355] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:19:05 2021] DELETE /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 16:19:05.969731 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-ff5434d3-0324-44ba-aa1a-b00ddde9c1ab tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:19:05.970568 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-ff5434d3-0324-44ba-aa1a-b00ddde9c1ab tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:19:05.976998 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ff5434d3-0324-44ba-aa1a-b00ddde9c1ab tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:05.977449 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ff5434d3-0324-44ba-aa1a-b00ddde9c1ab tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:05.978222 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ff5434d3-0324-44ba-aa1a-b00ddde9c1ab tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:05.978655 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-ff5434d3-0324-44ba-aa1a-b00ddde9c1ab tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:06.111569 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-ff5434d3-0324-44ba-aa1a-b00ddde9c1ab tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:19:06.119007 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-ff5434d3-0324-44ba-aa1a-b00ddde9c1ab tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1568 microversion: 2.1 time: 0.153301 Jul 30 16:19:06.120324 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 673/1356] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:19:05 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:19:06.394167 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-ed2c5e02-51af-425a-b45e-47097c32191e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:19:06.394887 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-ed2c5e02-51af-425a-b45e-47097c32191e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:19:06.401047 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ed2c5e02-51af-425a-b45e-47097c32191e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:06.401506 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ed2c5e02-51af-425a-b45e-47097c32191e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:06.402705 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ed2c5e02-51af-425a-b45e-47097c32191e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:06.403155 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-ed2c5e02-51af-425a-b45e-47097c32191e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:06.526769 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-ed2c5e02-51af-425a-b45e-47097c32191e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:19:06.535278 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-ed2c5e02-51af-425a-b45e-47097c32191e tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8" status: 200 len: 1266 microversion: 2.1 time: 0.145144 Jul 30 16:19:06.536089 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 684/1357] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:19:06 2021] GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:19:07.137965 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-639491b2-cac4-482d-ad64-52c0799787e1 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:19:07.138565 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-639491b2-cac4-482d-ad64-52c0799787e1 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:19:07.144432 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-639491b2-cac4-482d-ad64-52c0799787e1 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:07.144872 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-639491b2-cac4-482d-ad64-52c0799787e1 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:07.145621 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-639491b2-cac4-482d-ad64-52c0799787e1 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:07.146054 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-639491b2-cac4-482d-ad64-52c0799787e1 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:07.265949 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-639491b2-cac4-482d-ad64-52c0799787e1 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:19:07.273302 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-639491b2-cac4-482d-ad64-52c0799787e1 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1449 microversion: 2.1 time: 0.139511 Jul 30 16:19:07.273859 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 674/1358] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:19:07 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1449 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:19:07.552369 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-03a6625b-1ca8-4b74-9257-5c45e694c9ed tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:19:07.552925 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-03a6625b-1ca8-4b74-9257-5c45e694c9ed tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:19:07.559368 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-03a6625b-1ca8-4b74-9257-5c45e694c9ed tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:07.559816 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-03a6625b-1ca8-4b74-9257-5c45e694c9ed tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:07.560577 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-03a6625b-1ca8-4b74-9257-5c45e694c9ed tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:07.561009 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-03a6625b-1ca8-4b74-9257-5c45e694c9ed tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:07.703108 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-03a6625b-1ca8-4b74-9257-5c45e694c9ed tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:19:07.710419 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-03a6625b-1ca8-4b74-9257-5c45e694c9ed tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8" status: 200 len: 1266 microversion: 2.1 time: 0.161706 Jul 30 16:19:07.710977 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 685/1359] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:19:07 2021] GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:19:08.118508 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [req-40e02f3c-341c-4613-8141-021742069ce7 req-d1aacdee-9432-4545-90ee-b95c981aadad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a", "name": "network-vif-deleted", "tag": "aeca0f4b-877a-4418-be7e-80555a5d3358"}]} {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:19:08.120738 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:19:08.120738 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: warnings.warn(msg) Jul 30 16:19:08.127424 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-40e02f3c-341c-4613-8141-021742069ce7 req-d1aacdee-9432-4545-90ee-b95c981aadad service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:08.127899 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [req-40e02f3c-341c-4613-8141-021742069ce7 req-d1aacdee-9432-4545-90ee-b95c981aadad service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:08.139047 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.compute.server_external_events [req-40e02f3c-341c-4613-8141-021742069ce7 req-d1aacdee-9432-4545-90ee-b95c981aadad service nova] Creating event network-vif-deleted:aeca0f4b-877a-4418-be7e-80555a5d3358 for instance d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a on hv-cinder-80304 Jul 30 16:19:08.143552 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [req-40e02f3c-341c-4613-8141-021742069ce7 req-d1aacdee-9432-4545-90ee-b95c981aadad service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028624 Jul 30 16:19:08.144119 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 675/1360] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:19:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:19:08.290708 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0647ee8f-cd5d-44f8-8aa1-6232ae4ed75f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:19:08.291351 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0647ee8f-cd5d-44f8-8aa1-6232ae4ed75f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:19:08.297175 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0647ee8f-cd5d-44f8-8aa1-6232ae4ed75f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:08.297617 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0647ee8f-cd5d-44f8-8aa1-6232ae4ed75f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:08.298460 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0647ee8f-cd5d-44f8-8aa1-6232ae4ed75f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:08.298886 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0647ee8f-cd5d-44f8-8aa1-6232ae4ed75f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:08.357955 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0647ee8f-cd5d-44f8-8aa1-6232ae4ed75f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cd6f5201214bcea8ba2ca2acaaab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c425ffd8fd041f9b548ee591a2bd843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:19:08.365431 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0647ee8f-cd5d-44f8-8aa1-6232ae4ed75f tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 200 len: 1219 microversion: 2.1 time: 0.078398 Jul 30 16:19:08.366144 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 686/1361] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:19:08 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:19:08.726710 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e4c455af-f2fe-49e9-9109-1b858884dc9b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:19:08.727434 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e4c455af-f2fe-49e9-9109-1b858884dc9b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:19:08.733990 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e4c455af-f2fe-49e9-9109-1b858884dc9b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:08.734434 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e4c455af-f2fe-49e9-9109-1b858884dc9b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:08.735216 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e4c455af-f2fe-49e9-9109-1b858884dc9b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:08.735651 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e4c455af-f2fe-49e9-9109-1b858884dc9b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:08.856584 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e4c455af-f2fe-49e9-9109-1b858884dc9b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:19:08.864091 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e4c455af-f2fe-49e9-9109-1b858884dc9b tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8" status: 200 len: 1266 microversion: 2.1 time: 0.141443 Jul 30 16:19:08.864648 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 676/1362] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:19:08 2021] GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:19:09.382151 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-56c09eb9-7cb4-4866-b0c0-675a219a9f36 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:19:09.382773 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-56c09eb9-7cb4-4866-b0c0-675a219a9f36 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] [instance: d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:19:09.391278 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-56c09eb9-7cb4-4866-b0c0-675a219a9f36 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:09.391739 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-56c09eb9-7cb4-4866-b0c0-675a219a9f36 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:09.392536 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-56c09eb9-7cb4-4866-b0c0-675a219a9f36 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:09.392994 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-56c09eb9-7cb4-4866-b0c0-675a219a9f36 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:09.409761 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-56c09eb9-7cb4-4866-b0c0-675a219a9f36 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] HTTP exception thrown: Instance d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a could not be found. Jul 30 16:19:09.410364 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-56c09eb9-7cb4-4866-b0c0-675a219a9f36 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Returning 404 to user: Instance d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:19:09.411216 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-56c09eb9-7cb4-4866-b0c0-675a219a9f36 tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a" status: 404 len: 111 microversion: 2.1 time: 0.032721 Jul 30 16:19:09.411767 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 687/1363] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:19:09 2021] GET /compute/v2.1/servers/d4f7e0dc-1a76-41f9-acb3-23ff4efc6c9a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:19:09.568132 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-26a67e80-73a0-4889-99ae-36b982cf344c tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] Calling method '.version_select at 0x7fb17e8ace50>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:19:09.590534 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-26a67e80-73a0-4889-99ae-36b982cf344c tempest-TestShelveInstance-54119881 tempest-TestShelveInstance-54119881-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1170790236" status: 202 len: 0 microversion: 2.1 time: 0.025957 Jul 30 16:19:09.591046 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 677/1364] 10.222.0.37 () {58 vars in 1254 bytes} [Fri Jul 30 16:19:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1170790236 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 16:19:09.881589 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-4fbd4ae7-ba22-479d-95bd-c56f776a1397 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:19:09.882566 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-4fbd4ae7-ba22-479d-95bd-c56f776a1397 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:19:09.890143 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4fbd4ae7-ba22-479d-95bd-c56f776a1397 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:09.890592 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4fbd4ae7-ba22-479d-95bd-c56f776a1397 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:09.891714 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4fbd4ae7-ba22-479d-95bd-c56f776a1397 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:09.892156 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-4fbd4ae7-ba22-479d-95bd-c56f776a1397 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:10.114976 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-4fbd4ae7-ba22-479d-95bd-c56f776a1397 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:19:10.122964 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-4fbd4ae7-ba22-479d-95bd-c56f776a1397 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8" status: 200 len: 1266 microversion: 2.1 time: 0.245030 Jul 30 16:19:10.123561 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 688/1365] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:19:09 2021] GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:19:11.141763 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4ccfd4e7-c489-4e16-bb70-021c11804264 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:19:11.142404 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4ccfd4e7-c489-4e16-bb70-021c11804264 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:19:11.148644 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4ccfd4e7-c489-4e16-bb70-021c11804264 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:11.149157 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4ccfd4e7-c489-4e16-bb70-021c11804264 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:11.149934 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4ccfd4e7-c489-4e16-bb70-021c11804264 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:11.150548 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4ccfd4e7-c489-4e16-bb70-021c11804264 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:11.280665 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-4ccfd4e7-c489-4e16-bb70-021c11804264 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:19:11.295004 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4ccfd4e7-c489-4e16-bb70-021c11804264 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8" status: 200 len: 1266 microversion: 2.1 time: 0.156698 Jul 30 16:19:11.295981 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 678/1366] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:19:11 2021] GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:19:11.767392 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-1a6062e2-6443-4b20-b328-5f82fb48980c req-af4e51ba-7fec-425e-8be1-183a24d869aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57f0a67-c66f-4085-bb05-4361f5f783c8", "name": "network-vif-plugged", "status": "completed", "tag": "dc53c338-dfd0-433c-8622-0c4c81eba97d"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:19:11.769016 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:19:11.769016 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:19:11.777598 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-1a6062e2-6443-4b20-b328-5f82fb48980c req-af4e51ba-7fec-425e-8be1-183a24d869aa service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:11.778031 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-1a6062e2-6443-4b20-b328-5f82fb48980c req-af4e51ba-7fec-425e-8be1-183a24d869aa service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:11.790929 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-1a6062e2-6443-4b20-b328-5f82fb48980c req-af4e51ba-7fec-425e-8be1-183a24d869aa service nova] Creating event network-vif-plugged:dc53c338-dfd0-433c-8622-0c4c81eba97d for instance b57f0a67-c66f-4085-bb05-4361f5f783c8 on hv-cinder-80304 Jul 30 16:19:11.800362 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-1a6062e2-6443-4b20-b328-5f82fb48980c req-af4e51ba-7fec-425e-8be1-183a24d869aa service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093163 Jul 30 16:19:11.801186 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 689/1367] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:19:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:19:12.312662 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-e134c23f-29e1-4c66-9a27-850992b3657d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:19:12.313454 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-e134c23f-29e1-4c66-9a27-850992b3657d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:19:12.318934 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e134c23f-29e1-4c66-9a27-850992b3657d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:12.319415 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e134c23f-29e1-4c66-9a27-850992b3657d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:12.320177 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e134c23f-29e1-4c66-9a27-850992b3657d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:12.320605 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-e134c23f-29e1-4c66-9a27-850992b3657d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:12.462466 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-e134c23f-29e1-4c66-9a27-850992b3657d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:19:12.473148 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-e134c23f-29e1-4c66-9a27-850992b3657d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8" status: 200 len: 1266 microversion: 2.1 time: 0.164041 Jul 30 16:19:12.474292 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 679/1368] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:19:12 2021] GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:19:13.490874 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-0d13f86d-237f-4ec8-8023-fef9a1299803 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:19:13.491528 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-0d13f86d-237f-4ec8-8023-fef9a1299803 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:19:13.498296 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0d13f86d-237f-4ec8-8023-fef9a1299803 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:13.498737 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0d13f86d-237f-4ec8-8023-fef9a1299803 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:13.499525 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0d13f86d-237f-4ec8-8023-fef9a1299803 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:13.499949 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-0d13f86d-237f-4ec8-8023-fef9a1299803 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:13.619443 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-0d13f86d-237f-4ec8-8023-fef9a1299803 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:19:13.626596 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-0d13f86d-237f-4ec8-8023-fef9a1299803 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8" status: 200 len: 1453 microversion: 2.1 time: 0.139741 Jul 30 16:19:13.627172 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 690/1369] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:19:13 2021] GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8 => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:19:13.642166 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-1941a72f-bb79-4675-8bd2-352c06c8706c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:19:13.642854 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-1941a72f-bb79-4675-8bd2-352c06c8706c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:19:13.648773 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1941a72f-bb79-4675-8bd2-352c06c8706c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:13.649215 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1941a72f-bb79-4675-8bd2-352c06c8706c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:13.649977 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1941a72f-bb79-4675-8bd2-352c06c8706c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:13.650400 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-1941a72f-bb79-4675-8bd2-352c06c8706c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:13.874849 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-1941a72f-bb79-4675-8bd2-352c06c8706c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:19:13.882708 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-1941a72f-bb79-4675-8bd2-352c06c8706c tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8" status: 200 len: 1453 microversion: 2.1 time: 0.244107 Jul 30 16:19:13.883475 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 680/1370] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:19:13 2021] GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8 => generated 1453 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:19:16.534064 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-68dcef06-9438-4553-9432-6eeb68794b62 req-0db96027-5e6f-424a-a903-523ab1c16366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b57f0a67-c66f-4085-bb05-4361f5f783c8", "tag": "dc53c338-dfd0-433c-8622-0c4c81eba97d"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:19:16.536279 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:19:16.536279 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:19:16.543898 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-68dcef06-9438-4553-9432-6eeb68794b62 req-0db96027-5e6f-424a-a903-523ab1c16366 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:19:16.544633 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-68dcef06-9438-4553-9432-6eeb68794b62 req-0db96027-5e6f-424a-a903-523ab1c16366 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:19:16.558985 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-68dcef06-9438-4553-9432-6eeb68794b62 req-0db96027-5e6f-424a-a903-523ab1c16366 service nova] Creating event network-changed:dc53c338-dfd0-433c-8622-0c4c81eba97d for instance b57f0a67-c66f-4085-bb05-4361f5f783c8 on hv-cinder-80304 Jul 30 16:19:16.564279 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-68dcef06-9438-4553-9432-6eeb68794b62 req-0db96027-5e6f-424a-a903-523ab1c16366 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033704 Jul 30 16:19:16.565208 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 691/1371] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:19:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:20:48.866077 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-78249f8a-34a0-42f5-ad07-f64650c1f029 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:20:48.866653 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-78249f8a-34a0-42f5-ad07-f64650c1f029 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:20:48.878335 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-8217df54-7add-46c1-9f8c-c6fec4906cea req-dd208454-9550-4ea6-ad73-1dc22e05a6df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b57f0a67-c66f-4085-bb05-4361f5f783c8", "tag": "dc53c338-dfd0-433c-8622-0c4c81eba97d"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:20:48.879837 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:20:48.879837 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:20:48.883251 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-78249f8a-34a0-42f5-ad07-f64650c1f029 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:48.883710 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-78249f8a-34a0-42f5-ad07-f64650c1f029 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:48.884500 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-78249f8a-34a0-42f5-ad07-f64650c1f029 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:48.884943 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-78249f8a-34a0-42f5-ad07-f64650c1f029 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:48.886749 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-8217df54-7add-46c1-9f8c-c6fec4906cea req-dd208454-9550-4ea6-ad73-1dc22e05a6df service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:48.887232 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-8217df54-7add-46c1-9f8c-c6fec4906cea req-dd208454-9550-4ea6-ad73-1dc22e05a6df service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:48.898500 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-8217df54-7add-46c1-9f8c-c6fec4906cea req-dd208454-9550-4ea6-ad73-1dc22e05a6df service nova] Creating event network-changed:dc53c338-dfd0-433c-8622-0c4c81eba97d for instance b57f0a67-c66f-4085-bb05-4361f5f783c8 on hv-cinder-80304 Jul 30 16:20:48.904122 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-8217df54-7add-46c1-9f8c-c6fec4906cea req-dd208454-9550-4ea6-ad73-1dc22e05a6df service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033636 Jul 30 16:20:48.905448 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 692/1372] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:20:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:20:48.911043 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-78249f8a-34a0-42f5-ad07-f64650c1f029 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Going to try to terminate instance {{(pid=107453) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:20:48.991087 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-78249f8a-34a0-42f5-ad07-f64650c1f029 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "DELETE /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8" status: 204 len: 0 microversion: 2.1 time: 0.130503 Jul 30 16:20:48.994945 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 681/1373] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:20:48 2021] DELETE /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 16:20:49.000373 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-28c309ad-77b3-4f38-893f-97dfc9326868 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:20:49.001133 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-28c309ad-77b3-4f38-893f-97dfc9326868 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:20:49.007363 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-28c309ad-77b3-4f38-893f-97dfc9326868 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:49.007815 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-28c309ad-77b3-4f38-893f-97dfc9326868 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:49.008596 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-28c309ad-77b3-4f38-893f-97dfc9326868 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:49.009023 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-28c309ad-77b3-4f38-893f-97dfc9326868 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:49.213364 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-28c309ad-77b3-4f38-893f-97dfc9326868 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:20:49.221990 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-28c309ad-77b3-4f38-893f-97dfc9326868 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8" status: 200 len: 1578 microversion: 2.1 time: 0.225596 Jul 30 16:20:49.232183 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 693/1374] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:20:48 2021] GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8 => generated 1578 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:20:50.240877 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-c74bd305-a31e-4819-94b5-26eddfa34c73 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:20:50.241490 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-c74bd305-a31e-4819-94b5-26eddfa34c73 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:20:50.247367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c74bd305-a31e-4819-94b5-26eddfa34c73 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:50.247829 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c74bd305-a31e-4819-94b5-26eddfa34c73 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:50.248620 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c74bd305-a31e-4819-94b5-26eddfa34c73 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:50.249115 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-c74bd305-a31e-4819-94b5-26eddfa34c73 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:50.373108 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-c74bd305-a31e-4819-94b5-26eddfa34c73 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:20:50.381125 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-c74bd305-a31e-4819-94b5-26eddfa34c73 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8" status: 200 len: 1459 microversion: 2.1 time: 0.144409 Jul 30 16:20:50.381678 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 682/1375] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:20:50 2021] GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8 => generated 1459 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:20:51.052315 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-78daac62-e9b3-4048-abaf-f53d6a7e68ce req-2f31902c-c7ab-4345-b234-c883ffcc9de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57f0a67-c66f-4085-bb05-4361f5f783c8", "name": "network-vif-deleted", "tag": "dc53c338-dfd0-433c-8622-0c4c81eba97d"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:20:51.053651 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:20:51.053651 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:20:51.060429 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-78daac62-e9b3-4048-abaf-f53d6a7e68ce req-2f31902c-c7ab-4345-b234-c883ffcc9de7 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:51.061029 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-78daac62-e9b3-4048-abaf-f53d6a7e68ce req-2f31902c-c7ab-4345-b234-c883ffcc9de7 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:51.077968 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-78daac62-e9b3-4048-abaf-f53d6a7e68ce req-2f31902c-c7ab-4345-b234-c883ffcc9de7 service nova] Creating event network-vif-deleted:dc53c338-dfd0-433c-8622-0c4c81eba97d for instance b57f0a67-c66f-4085-bb05-4361f5f783c8 on hv-cinder-80304 Jul 30 16:20:51.085414 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-78daac62-e9b3-4048-abaf-f53d6a7e68ce req-2f31902c-c7ab-4345-b234-c883ffcc9de7 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036766 Jul 30 16:20:51.086272 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 694/1376] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:20:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:20:51.401590 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-a5d69cdb-a6c5-4b87-8407-143998a51e6f tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:20:51.402333 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-a5d69cdb-a6c5-4b87-8407-143998a51e6f tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:20:51.410990 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a5d69cdb-a6c5-4b87-8407-143998a51e6f tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:51.411769 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a5d69cdb-a6c5-4b87-8407-143998a51e6f tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:51.412550 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a5d69cdb-a6c5-4b87-8407-143998a51e6f tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:51.412991 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a5d69cdb-a6c5-4b87-8407-143998a51e6f tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:51.454836 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a5d69cdb-a6c5-4b87-8407-143998a51e6f tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:51.455480 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-a5d69cdb-a6c5-4b87-8407-143998a51e6f tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:51.455887 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.objects.instance [None req-a5d69cdb-a6c5-4b87-8407-143998a51e6f tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lazy-loading 'fault' on Instance uuid b57f0a67-c66f-4085-bb05-4361f5f783c8 {{(pid=107453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 30 16:20:51.496565 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-a5d69cdb-a6c5-4b87-8407-143998a51e6f tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:20:51.504431 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-a5d69cdb-a6c5-4b87-8407-143998a51e6f tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8" status: 200 len: 1230 microversion: 2.1 time: 0.106463 Jul 30 16:20:51.504986 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 683/1377] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:20:51 2021] GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8 => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 16:20:52.522452 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-507e8a05-36bd-48a2-87c1-377c564aecdd tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:20:52.523156 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-507e8a05-36bd-48a2-87c1-377c564aecdd tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: b57f0a67-c66f-4085-bb05-4361f5f783c8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:20:52.529449 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-507e8a05-36bd-48a2-87c1-377c564aecdd tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:52.529901 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-507e8a05-36bd-48a2-87c1-377c564aecdd tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:52.530656 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-507e8a05-36bd-48a2-87c1-377c564aecdd tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:52.531084 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-507e8a05-36bd-48a2-87c1-377c564aecdd tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:52.544498 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-507e8a05-36bd-48a2-87c1-377c564aecdd tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] HTTP exception thrown: Instance b57f0a67-c66f-4085-bb05-4361f5f783c8 could not be found. Jul 30 16:20:52.545016 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-507e8a05-36bd-48a2-87c1-377c564aecdd tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Returning 404 to user: Instance b57f0a67-c66f-4085-bb05-4361f5f783c8 could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:20:52.545834 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-507e8a05-36bd-48a2-87c1-377c564aecdd tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8" status: 404 len: 111 microversion: 2.1 time: 0.027457 Jul 30 16:20:52.546712 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 695/1378] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:20:52 2021] GET /compute/v2.1/servers/b57f0a67-c66f-4085-bb05-4361f5f783c8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:20:55.813541 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-4e2cf00f-e538-4ca6-8665-f0544d963801 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:20:55.814249 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4e2cf00f-e538-4ca6-8665-f0544d963801 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:20:55.819179 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-9ff71f81-17ec-43ce-91e4-fa5d0617a392 req-47325a51-31e2-49a4-8c05-96a3f2458c9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b2fe30-3bbe-4414-8cc3-6ac435a5288e", "tag": "097e775d-f23f-4ca8-a3e3-ef121c4f29d3"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:20:55.820504 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4e2cf00f-e538-4ca6-8665-f0544d963801 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:55.820677 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:20:55.820677 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:20:55.821085 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4e2cf00f-e538-4ca6-8665-f0544d963801 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:55.821969 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4e2cf00f-e538-4ca6-8665-f0544d963801 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:55.822459 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-4e2cf00f-e538-4ca6-8665-f0544d963801 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:55.827495 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-9ff71f81-17ec-43ce-91e4-fa5d0617a392 req-47325a51-31e2-49a4-8c05-96a3f2458c9c service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:55.827932 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-9ff71f81-17ec-43ce-91e4-fa5d0617a392 req-47325a51-31e2-49a4-8c05-96a3f2458c9c service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:55.839883 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-9ff71f81-17ec-43ce-91e4-fa5d0617a392 req-47325a51-31e2-49a4-8c05-96a3f2458c9c service nova] Creating event network-changed:097e775d-f23f-4ca8-a3e3-ef121c4f29d3 for instance 00b2fe30-3bbe-4414-8cc3-6ac435a5288e on hv-cinder-80304 Jul 30 16:20:55.845166 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-9ff71f81-17ec-43ce-91e4-fa5d0617a392 req-47325a51-31e2-49a4-8c05-96a3f2458c9c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029545 Jul 30 16:20:55.846063 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 696/1379] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:20:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:20:55.848352 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-4e2cf00f-e538-4ca6-8665-f0544d963801 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Going to try to terminate instance {{(pid=107453) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 30 16:20:55.929695 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-4e2cf00f-e538-4ca6-8665-f0544d963801 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "DELETE /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 204 len: 0 microversion: 2.1 time: 0.120222 Jul 30 16:20:55.930325 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 684/1380] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:20:55 2021] DELETE /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 16:20:55.940103 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-14c3e207-787e-4e70-bed3-304cbbb7150d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:20:55.940796 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-14c3e207-787e-4e70-bed3-304cbbb7150d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:20:55.946904 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-14c3e207-787e-4e70-bed3-304cbbb7150d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:55.947440 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-14c3e207-787e-4e70-bed3-304cbbb7150d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:55.948217 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-14c3e207-787e-4e70-bed3-304cbbb7150d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:55.948651 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-14c3e207-787e-4e70-bed3-304cbbb7150d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:56.157950 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.policy [None req-14c3e207-787e-4e70-bed3-304cbbb7150d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107452) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:20:56.165624 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-14c3e207-787e-4e70-bed3-304cbbb7150d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 200 len: 1580 microversion: 2.1 time: 0.230403 Jul 30 16:20:56.166285 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 697/1381] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:20:55 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 1580 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:20:57.185229 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-f777816c-df6d-4406-a3e6-c645c767172d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:20:57.185846 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-f777816c-df6d-4406-a3e6-c645c767172d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:20:57.192377 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f777816c-df6d-4406-a3e6-c645c767172d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:57.192817 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f777816c-df6d-4406-a3e6-c645c767172d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:57.193573 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f777816c-df6d-4406-a3e6-c645c767172d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:57.193996 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-f777816c-df6d-4406-a3e6-c645c767172d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:57.316043 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-f777816c-df6d-4406-a3e6-c645c767172d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:20:57.323258 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-f777816c-df6d-4406-a3e6-c645c767172d tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 200 len: 1461 microversion: 2.1 time: 0.142148 Jul 30 16:20:57.323841 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 685/1382] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:20:57 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 1461 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:20:58.130784 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [req-3774b01d-482d-4ed4-915a-df26f4d28abc req-bd167e22-3771-4aa8-bc6c-a83d6fe626e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b2fe30-3bbe-4414-8cc3-6ac435a5288e", "name": "network-vif-deleted", "tag": "097e775d-f23f-4ca8-a3e3-ef121c4f29d3"}]} {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 16:20:58.132315 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 16:20:58.132315 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: warnings.warn(msg) Jul 30 16:20:58.139942 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-3774b01d-482d-4ed4-915a-df26f4d28abc req-bd167e22-3771-4aa8-bc6c-a83d6fe626e1 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:58.140411 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [req-3774b01d-482d-4ed4-915a-df26f4d28abc req-bd167e22-3771-4aa8-bc6c-a83d6fe626e1 service nova] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:58.152289 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.compute.server_external_events [req-3774b01d-482d-4ed4-915a-df26f4d28abc req-bd167e22-3771-4aa8-bc6c-a83d6fe626e1 service nova] Creating event network-vif-deleted:097e775d-f23f-4ca8-a3e3-ef121c4f29d3 for instance 00b2fe30-3bbe-4414-8cc3-6ac435a5288e on hv-cinder-80304 Jul 30 16:20:58.157824 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [req-3774b01d-482d-4ed4-915a-df26f4d28abc req-bd167e22-3771-4aa8-bc6c-a83d6fe626e1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030558 Jul 30 16:20:58.158446 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 698/1383] 10.222.0.37 () {64 vars in 1318 bytes} [Fri Jul 30 16:20:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 16:20:58.340751 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-8d3ebbc3-e34e-4989-a3e2-9a2ae251f2b7 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:20:58.341272 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-8d3ebbc3-e34e-4989-a3e2-9a2ae251f2b7 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:20:58.346977 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8d3ebbc3-e34e-4989-a3e2-9a2ae251f2b7 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:58.347461 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8d3ebbc3-e34e-4989-a3e2-9a2ae251f2b7 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:58.348224 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8d3ebbc3-e34e-4989-a3e2-9a2ae251f2b7 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:58.348653 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-8d3ebbc3-e34e-4989-a3e2-9a2ae251f2b7 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:58.419895 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.policy [None req-8d3ebbc3-e34e-4989-a3e2-9a2ae251f2b7 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3885b43f9a4d32aab4abebece046c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bf3493a71648c895b14d999b3bfb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 16:20:58.428292 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-8d3ebbc3-e34e-4989-a3e2-9a2ae251f2b7 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 200 len: 1226 microversion: 2.1 time: 0.091213 Jul 30 16:20:58.428871 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 686/1384] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:20:58 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 16:20:59.445335 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-19e5d4da-264f-4b9e-9a9a-7d61a59ab4ff tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:20:59.446026 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-19e5d4da-264f-4b9e-9a9a-7d61a59ab4ff tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 00b2fe30-3bbe-4414-8cc3-6ac435a5288e] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:20:59.452080 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-19e5d4da-264f-4b9e-9a9a-7d61a59ab4ff tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:59.452525 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-19e5d4da-264f-4b9e-9a9a-7d61a59ab4ff tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:59.453279 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-19e5d4da-264f-4b9e-9a9a-7d61a59ab4ff tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:59.453715 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-19e5d4da-264f-4b9e-9a9a-7d61a59ab4ff tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:59.467212 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-19e5d4da-264f-4b9e-9a9a-7d61a59ab4ff tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] HTTP exception thrown: Instance 00b2fe30-3bbe-4414-8cc3-6ac435a5288e could not be found. Jul 30 16:20:59.467835 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-19e5d4da-264f-4b9e-9a9a-7d61a59ab4ff tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Returning 404 to user: Instance 00b2fe30-3bbe-4414-8cc3-6ac435a5288e could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:20:59.468640 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-19e5d4da-264f-4b9e-9a9a-7d61a59ab4ff tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e" status: 404 len: 111 microversion: 2.1 time: 0.027393 Jul 30 16:20:59.469657 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 699/1385] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:20:59 2021] GET /compute/v2.1/servers/00b2fe30-3bbe-4414-8cc3-6ac435a5288e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:20:59.917821 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-08701d20-442c-4bbf-b727-886aeec0c256 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:20:59.918367 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.compute.api [None req-08701d20-442c-4bbf-b727-886aeec0c256 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107453) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:20:59.924633 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-08701d20-442c-4bbf-b727-886aeec0c256 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:59.925315 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-08701d20-442c-4bbf-b727-886aeec0c256 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:59.926195 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-08701d20-442c-4bbf-b727-886aeec0c256 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:59.926836 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG oslo_concurrency.lockutils [None req-08701d20-442c-4bbf-b727-886aeec0c256 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:59.941490 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.wsgi [None req-08701d20-442c-4bbf-b727-886aeec0c256 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] HTTP exception thrown: Instance 36700cb8-81e3-47e4-96f9-9b417e29aef8 could not be found. Jul 30 16:20:59.942077 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-08701d20-442c-4bbf-b727-886aeec0c256 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Returning 404 to user: Instance 36700cb8-81e3-47e4-96f9-9b417e29aef8 could not be found. {{(pid=107453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:20:59.942890 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-08701d20-442c-4bbf-b727-886aeec0c256 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "DELETE /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 404 len: 111 microversion: 2.1 time: 0.028870 Jul 30 16:20:59.943445 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 687/1386] 10.222.0.37 () {58 vars in 1239 bytes} [Fri Jul 30 16:20:59 2021] DELETE /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:20:59.951305 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-affe1e91-e9d3-45a9-82c7-1e86d43a866a tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '>' {{(pid=107452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:20:59.951906 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.compute.api [None req-affe1e91-e9d3-45a9-82c7-1e86d43a866a tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] [instance: 36700cb8-81e3-47e4-96f9-9b417e29aef8] Fetching instance by UUID {{(pid=107452) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 30 16:20:59.958059 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-affe1e91-e9d3-45a9-82c7-1e86d43a866a tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:59.958497 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-affe1e91-e9d3-45a9-82c7-1e86d43a866a tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:59.959272 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-affe1e91-e9d3-45a9-82c7-1e86d43a866a tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 30 16:20:59.959696 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG oslo_concurrency.lockutils [None req-affe1e91-e9d3-45a9-82c7-1e86d43a866a tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Lock "ef005b1d-69a0-4b69-b2a9-e8f27f5362c8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 30 16:20:59.973048 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.wsgi [None req-affe1e91-e9d3-45a9-82c7-1e86d43a866a tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] HTTP exception thrown: Instance 36700cb8-81e3-47e4-96f9-9b417e29aef8 could not be found. Jul 30 16:20:59.973619 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: DEBUG nova.api.openstack.wsgi [None req-affe1e91-e9d3-45a9-82c7-1e86d43a866a tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Returning 404 to user: Instance 36700cb8-81e3-47e4-96f9-9b417e29aef8 could not be found. {{(pid=107452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 30 16:20:59.974413 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO nova.api.openstack.requestlog [None req-affe1e91-e9d3-45a9-82c7-1e86d43a866a tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8" status: 404 len: 111 microversion: 2.1 time: 0.026771 Jul 30 16:20:59.974915 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: [pid: 107452|app: 0|req: 700/1387] 10.222.0.37 () {58 vars in 1236 bytes} [Fri Jul 30 16:20:59 2021] GET /compute/v2.1/servers/36700cb8-81e3-47e4-96f9-9b417e29aef8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 16:21:01.252670 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: DEBUG nova.api.openstack.wsgi [None req-fa14655e-741c-453c-bdd4-48fb7757cfc8 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] Calling method '.version_select at 0x7fb17e83caf0>' {{(pid=107453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 16:21:01.277436 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO nova.api.openstack.requestlog [None req-fa14655e-741c-453c-bdd4-48fb7757cfc8 tempest-TestVolumeBootPattern-48604633 tempest-TestVolumeBootPattern-48604633-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2065592267" status: 202 len: 0 microversion: 2.1 time: 0.028346 Jul 30 16:21:01.278278 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: [pid: 107453|app: 0|req: 688/1388] 10.222.0.37 () {58 vars in 1263 bytes} [Fri Jul 30 16:21:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2065592267 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 16:21:51.726854 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 16:21:51.727575 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: Fri Jul 30 16:21:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 16:21:58.626310 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 16:21:58.626871 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: Fri Jul 30 16:21:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 16:22:06.922780 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 16:22:06.923520 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: Fri Jul 30 16:22:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 16:23:38.285869 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 16:23:38.286405 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: Fri Jul 30 16:23:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 16:24:00.660077 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 16:24:00.660643 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: Fri Jul 30 16:24:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 16:24:06.524732 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 16:24:06.525298 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: Fri Jul 30 16:24:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 16:25:11.744644 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 16:25:11.745245 dv-cinder-803046-3-iscsi devstack@n-api.service[107453]: Fri Jul 30 16:25:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 16:25:18.643607 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 16:25:18.644243 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: Fri Jul 30 16:25:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 16:25:26.940819 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 16:25:26.941496 dv-cinder-803046-3-iscsi devstack@n-api.service[107452]: Fri Jul 30 16:25:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!